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This supplement to the 1979-80 Reading/Literature Released 
Exercise Set (no. ll-RL-25) contains only copies of the passages 
for all p1979-80 released open-endgd (responding written works) 
items, including documen^tation pages, scoring guides and numerous 
samiile responses illustrative of the various score points list*ed 
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H-40l000-BlB-2,3* 

Read the story below and then answer the questions on the next two pages. 

. Somebody's Son , > 

He sat, washed \w) on the side of the highway, a slim, sun- 
beaten driftwood of a'youth. He was hunched on his strapped- 
together suitcase, chin on hands, elbows on knees, staring 
down the road. Not a car was in sight Except for him, the 
dead, still Dakota plains were empty. *' 

Now he yas eager to write that letter he had kept putting 
off. Somehow, writing it would be almost like having 
company. 

He unstrapped his suitcase and fished out a small unopen- 
ed package of stationery from the pocket on the underside of 
the lid. Sitting down in the gravel of the roadside, he closed 
the suitcase and used it as a desk. 

Dear Mom, 

If Dad will permit, I would like to come homje. I 
know there's little chance he will. I'm not going" to 
kid myself. I remember he said once if I ever ran off 
I mig|:it as well keep on going. ^ 

All I can say is that I felt leaving home was some- 
thing I had to do. Before even considering college, I 
wanted to find out more about life and about me and 
the best way for us (life and me) to live with each 
other. Please tell Dad— and I guess this'll make hi^i 
sore 'all over again— I'm still not certain that college 
is the answer for me. I think I'd like to work for a ^ 
time and think it over. ' - , 

You won't be able to reach me by mail, because 
I'm not sure where I'll be next. But in a few days I 
hope to be passing by our place. If there's any chance 
Dad will have me back, please ask him to tie a white 
cloth to the apple tree in the south pasture— you know 
.the one, the Grimes Golden beside the tracks. I'll be, 
going by on the train. If there's no cloth on the tree 
I'll just quietly, and without any hard feelings toward 
Dad— I mean that— keep on going. 

J ' Love, 

David 



PLEASE CONTINUE ON THE NEXT PAGE 
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H».'4OX000-BlB-2,3* 
(Continued) 



p. Think about the atory again. What kind of person is David? Deacribe 
David in a few words on the line below. 



E. What was it about the story that led you to describe David the way you 
^ did in Question D? Write your answer on the lines below. 




STOP 
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DO NOT CONTINUE 
UNTIL TOLD TO DO SO. 
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Th6 .rahqe*^»of response peccentage valviaa listed foe the - 
open-ended portion cl this execcise repieaent both 
acceptable reaponaesr which ace nacked with an asterisk 
{*) , and unacceptable ceaponses (all o^theca) . In 
addition, the*, sooce points marked with' tWe . a?>cond 
alphabetic codes (C,F,SR or N) refer bacJt to the second 
and third categprlzations on the scoring; guide. 
c«content, F-forin, SR«subjective reaction, and N^number 
of pieces o<£ evidence. For convenience, score points 1 
and 2 have been combined into 3, and score points H and 5 
have been combined ihto 5*. Fdr exercises withou't a 
score point 1 on the scoring guide, the percentage value 
for sco?6 point 1 on the documentation page consiata of 
responses from score point 2 only. 



3)^QRING QUIDE^-RESPONDINQ TO LITERATURE 
^XPLAININQ RESPONSES TO LITERATURE 



Infaranoing-*Chir«Qtar 
"Somabody' a Son" 
H-^01000-B1B-a,3 . 
Age X3f Package 10, Exercise' 3 
Age 17, Paokaga 10, Exaroiaa 6 ^ 

General Soorlng Rablbnale ;' ?lnoe the reaponulpg to 
literature objeotlve was fo^^mulated to address 
"delibera^te, oonsolous kinds of , Inter |)r eta t Ion a 
auooessful rasponse not only should Identi fy a 
oharabter trait appropriate to David but.also should 
• explain the given interpretation by ralating it to the' 
, text. Evidence can be given 'by oit*lng spaoifio events 
in fthe text or special aspects of the' construction of 
[ the tex t . 

NOTE: Rating should, in genfirai, be done by taking the 
entire student response, Into "Consideration without 
regard to what is actually written in the space 
provided for the first* part and for the second part ojT 
the response. If reasons (substantial) are given in 
the first part they are valid. .The same 1:^* true for 
character tnaits identified in ths^ --second pa>t. 
Cavtion should, however be; used , as this often leads- 
to a. tendency ^ to . ' rewrite, the responses. 
' Catagorizations should reflect, as cloSely. as- possible , 
what^ respondents actually wrote. » 

Scoring Guide Categories ; , . ' 

I. First. ' '^atagorization ?'*I,dentlf Ication and 
substantiation of ' character traits. This takes 

..into account both open-ended parts.- ^ 

— — ■ i? . * ... 

* • 1 Unable to ' identi f y chat^ajQ^ter . traits . 
Respondents do not do the task. ' They refer to 
the text, but do not answer even 'the' first. 
" question . 

0 A. Only an opinion about; the^ action of the 

character ■ is offered, such as: "Da^yid 
V 'loiildn ' t» have left home.". ' V^^ 

. ^ / . \. ' ^ . 

% ; B. Some materi-al is quoted from the text with 

no clear identification of characte'r^ 
( including quoting t'itle) . 




e, Thi tdenfcifiQafciQn anil subsfeanfcUfeian of 
D, An absarvibton iboufc §fcQry U msde, far 

oWnoT go on . Th§y identify i ahericifcir 
briiit(8y but do not gub8t©ntiit§ th© Qhoia©(^) 
with ©vidtnoi from th© t©xt, R©gponi©,d t©nd to 
provid©j 1) Qiroulair ©videno©, 2) © Qopy or 
olpa© paraphrad© of th© t©xt| 3) vagu© raaaonai 
or only a aubjaotiv© r©aQtion 

aubatantiation « 

Chara^tar trait Idanti ft^d and aubatantiatad 

oharaotar trait'(a; anJ aubatantiat© th©ir 
ohoio©(a) with only on© raaaon or pi©o© of 
ovidano© rieilatad to th© t©xt, 

A, Reeaon oan b© diraotly ralatad to th© text, 
for , example: "Nioe, he wanta to o^^ma 
home," 

B. Reaaon oan be inferred from the text, 

C\ ^Reason oan be Inaoourate, if It la related 
to th^ text, for example: "3mart, since he 
final^ly decided to go to^ college," 

D, Reason can be based on personal experience 
that is related to the text, 

E, Reason can be unusual, such as: "Sunburned 
from sitting out on the road,f" or' "Lost, 
out in. the road with no one around for 
miles." 

F, Reason can refer* to (but, not retell) 
vspecific places in th^ cext, for example: 

"The letter" is not specific enough. Also, 
referring to' the place where specific 
adjectives were quoted from is merely a 
circular reason, • 

Character 'tr^lt identified and substantiated , 
Respondents identify, character traitC s) and 
substantiate their choice(s) with at least two 
•reasons or pieces of evidence rel ated to the 



'^text. However, the evidence may be presented 
-in an ambiguous fashion or be of the types 
described in 3C-3F. Reasons mu^t be distinct — 
not instances of the same reason such as: **It 
had sad parts not any happy parts." .^lis Is 
a restatement of the same reason. Other 
instances of single reasons are when it takes 
two bits of information to make a single point, 
. for example: (wanted to think things over) "He 
said he wanted to come home, but he didn^t 
think he was ready for collefee." 

5 g Gharaoter trait Ideatified and substantiated in 

• a coherent fashion * Respondents identify 
character trait( s) . and substantiate their 
choice(s) with at least two reasons or pieces 
of evidence ^ clearly r^elated . to the 
textr-directly related or can be readily 
inferred. The reasons are presented logically 
and coherently. ^- 

NOTE: The following types of papers were 
classified as indicated and received no further 
scoring: 

b No response . 

7 = Ille gible or illiterate ! 

— " — ' — [ — ~ 

8 = Totally off task . 

9 ,= "I don^ t know ;^" 

Second^ Gategor i^^ation ^'^The source of the evidence. 
Gode presence or absence for each of the following^ 

*• . ' <^ ■ " ' 

1 g Go n tent . The evidence is based on the content 

<5f ^he text. 

2 s Form . The evidence is based on the language, 
, sfyTe or construction of the text. 

3s Subjective reactions . These are responses that 

* . judge -the worth of all or part of the text, 
.such, as: "It was • interesting" or "It was 

ijipnotonous ." Personal, opinions about the 
actions of the characters are stated, such as: 
"David should not have ruif away" or references 
' to the moral of the story or general 
philosophical statements are made. 



NOTE: Content and form can be present only if 
primary categorization is a "3" througH "5"; 
subjective reactions can be present in papers 
categorized "2" .through "5." 

III. Third Categorize tion «""*A count pf jbhe number of 
reasons or pieces of evidence. Categorization for 
* » the count of details is as follows: (1), (2), (3)f 
(4), (5), (6), (7 or more) NOTE: This cdunt only 
applies to papers with prim<^.ry , categorization of 
••3" through "5"; subjective reacxions should not be 
counted as r^easons oc evidence. 
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Age 13 
Scxare Point ? (Cont. ) 
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Age 13 
Score Point 4 (Cont.) 
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Age 13 
Subjective Rekctlons 
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Age 13 ' 
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Age 17 
Score i^int 2 



Age 17 
Score Point 3 
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Age 17 ^ 
Score Point 3 (Cont.) 
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Age 17 
Sooire Point 4 (Cont.) 
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Age 17 
Score Point 5 
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Age 17 
Score Point 5 (Cont.) 
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Sccare Point 5 (Cont.) 
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ScxMca Point 5 (Cont.) 
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Oontant (Gont, ) 
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H'.4Q20QQ«BlB-2,3* 



Read the story below, Then write down your thoughts and feelinga about the 
ory on the linea provided on the nejtt two pages, We are interested in what 
you have to say, not j^our spelling and punctuation. You will have D minutes to 
read the atory and write your response. 

Somebod^r's Son 

He sftt, washed up on the side of t)ie highway, a slim, sun- 
beaten driftwood of a youth. He was hunched on his strapped- 
together suitcase, chin on hands, elbows on knees, staring 
down the, road. Not a car was in sight. Except for him, the 
dead, still ^^Dakota plains were empty. . 

Now he was eager to write that letter he had kept putting 
off.^ Somehow, writing it would be almost tike having 
company. ./^ 

He unstrapped his suitcase and fished out. a small unopen- 
ed package of stationery from the pocket on the underside of 
the lid. Sitting dqwn in the gravel of the roadside, he closed ' 
the suitcase and used it aj| a desk. ' 

v,( bear Morp, ^ " 

• If Dad will permit, I would like to come home. I * 
know there's little chance he will. I'm not going to 
kid myself. I remember he said once if I ever ran off 
I might as well keep on going. 

All I can say is that I felt leaving home was some- 
thing I had to do. Before even considering college, I 
wanted to find out more'about life and about me and 
the best way for us (life and me) to live with each 
other. Please tell Dad—and I guess this'Il make him 
sore all over again— I'm still not certain that college 
is the answer for ms. I think I'd like to work for a 
time and think it oyer. 

You won't be able to reach me by mail, because 
. I'm not sure where I'll be next.-But in a few days I 
hope to be'passing by our glace. If there's any chance 
s Dad will have me back, please ask him to tie a white 

cloth to the apple tree in the south pasture— you know 
the one, the Grimes Golden beside the tracks. I'll be ^ 
going by on the train. If there's no cloth on the tree 
I'll just quietly, and without any hard feelings toward ■ . 
Dad-^I mean that— keep on going. 

Love. 

David , . 

. r-^ — — — ^ —A 

• ' PLEASE CONTINUE ON THE NEXT PAGE 



H-402000-BlB-2,3* 

(Continued) 



IF YOU NEED MORE SPACE, CONTINUE ON THE NEXT PAGE. 



41 



37 



ERIC 



H-402000-Bl6-2,3* • 
(Continued) 




^rfSO I DO NOT CONTINUE 
aiWn UNTIL TOLD TO DO SO. 



42 



38 



HASP No.: 



H-a02000-B1B-23 * 



Exercise Type: 
Passage Type: 
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Responds to written vorks in 
interpretive and evaluative ways 

Applies peri^onal experience or 
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of study to written works 

Hand Scored 



& OA fi - . 

o . * 






1 % 

^^^^ 


17 




0 1 


CI 




> 7 O . «7 O 




00 


p 


1 (kl 


. ' J 




0 1 


P 




1 11 


f 


02 


p 


56,79 


67. 16 




03 


p 


3. a? 


1. 16 




Oil 


It 


1 0 • / / 


1 Q "Til 




05 


p 


. 5.10 


3.06 




06 


p 


.19 


.29 






p 




• C f 




08 


■ p 


.29 


.06 




09 


p 


9.92 


6.04 




88 


p 


.99 


.70 




10 


p 


.00 


.06 




11 


p 


.00 


.0? 




12 


p 


' .00 


.13. 




01 


EG 


5.05 


1.58 




01 


PR 


73.98 


81 .98 




01 


EM 


21.02 


17.61 




01 


HT 


U2.43 


48.60 




01 


IN 


29.10 


23.43 




01 


. 6N 


1.23 


1.28 




01 


AN 


a. 68 


4.42 




01 


ON 


a. 10 


1.82 




01 


EV 


22.70 


19.20 




01 


X 


.00 


.48 




01 


r 


.00 


.54 




01 


z 


.00 


4.84 


1979-80 










Package Exercise: 






.0904 


0904 


Total Time in Seconds: 






• .0558 . 


0557 
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Ihe range of response codes for this exercise Is quite 
broad^ and the letter codes on this pag^ tend to refer 
back to the corresponding codes on the scoring guide. 
Exceptions are the "R" code, vhich represents the total 
percentage of responses judged to be ratable, and the 
values associated vith the "P« code, which indicate the 
frequency with which each of the numerous response 
categories vas selected as being predominant. 



\ 
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SCORING GUIDEr-RESPONDING TO LITERATURE. 



General Responding 
"Somebody* 3 Son" 
H-402000--B1B-2,3 
Age 13f Package 9t Exercise 4 



General Scoring ^Rationale ; There are several major ways to 
deepen understandlni^ of a written work. Respondents 
can use awareness of emotional impact, personal 
experience and knowledge of other works to interpret , 
provide meaning , evaluate and analyze the text. A 
content analysis of the responses not only provides 
information about which internal resources respondents 
tend to draw upon to help their understanding of 
written works , but also the cognitive skills they 
choose to demonstrate when given an opportunity to 
respond ^freely. It is expected that the results m'ay^be 
highly text dependent. Also, the better responses 
should move beyond plot summary and retelling to 
provide meaning , evaluation and particularly analysis. 

Scoring Guide Categories : 

Descriptive information: Code each type as present or 
absent. Code one type as predpminant. 

EG s Egocentric , Responses are not text baaed, but 
are text relevant. Respondent writes a letter or 
story of his own or writes another story (or 
excerpts) that he has memorized. Other types 
of statements categorized here are: "I never 
read stories"; "I'm not good with stories"; or 
"I'm sorry to run cut on you, I don't wa^nt to go 
t<r college, either." T ^ 

PR s Personal . Respondent identifies with characters, 
makes Judgments about actions^ of characters or 
gives advioe, for example: ' "I might have done 
the same thing," "David shouldn't have left 
home," "His father should take him back," 
"Hopefully^ his father will tie the cloth on the 
tree," or statements, such as: "I like stories 
like. that" or "This is not my kind of story." 
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EM s Emotional . Respondent attributes emotions /to the 
text or makes a direct statement of emotioni for 
example: "The story was sad," "It's touching," 
"It. had a funny feel ingV* "It was very dramatic," 
or "I felt sorry for the boy." 

RT s Retelling . Respondent summarizes or paraphrases 
the story (or parts of it) using specific words 
from the story. Respondent gives a synopsis, 
overview or brief description of the story or 
part(s) of it. (Disregard inaccuracies.) 

IN s Inferencing . Respondent goes beyond the text and 
provides motivations for characters, for example: 
"David learned a lesson," "David's parents needed 
him to help pay the bills," or "David feels that 
his fath3r doesn't love him." 

o 

GN s Generalization . Respondent attributes meanings 
to the story, for example: "Go out and try new 
things," "It shows that people have feelings that 
can be hurt and people are the ones that hurt 
each other," or "Everyone knows you can-t run 
away from your problems." 

AN s Analysis . Respondent discusses the language 
and/or structure of the story, for example: "It 
could have more details and not so. many long, 
words," "I didn't see any misspelled words," "It 
wasn't long enough," or "The author uses 
imaginative language;" 

OW 2 Other works . Respondent classifies. the work as 
Yo genre or type iand compares the story to other 
works or art forms, such as: "It's not like a 
story I've seen before," or "I think it's a good 
soap opera." 

EV s Evaluation . Respondent judges the worth of the 
work, for example: "It was stupid," "I don't 
like it," "I didn't understand It," "It doesn't 
make sense," "It is nicely written," "It was not 
exciting or sad," "It has no meaning," or "It is 
imaginative." * 

NOTE: In addition? to the papers which were considered 
rateable (1 s rateable) and which were analyzed using the 
categories described above, some * papers were not 
considered rateable, and these were placed in one of the 
following classifications: 
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0 s No response , 

2 5 Nonrateable , Copies or circular, 

7 s Illegible, illiterate , 

8 s Totally off task / 

9 5 donU know." 



ERIC 



° Age 13 
Score Point EG (Egocentric) 



,2^^Jl^ uJCLJ phttti^ ^'^^ '^^^'^ 

hneil )7f oixJ> — - I 




44 ^8 



) 



Age 13 
Score Point EG (Cont.) 
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*Age 13 
Score Point EG ( Cant. ) 




0^fVT\¥-<-A 



^0 
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Age 13 
Score Point EG (Cont, ) 



MlP-^-h" fig I J/ H ( nr\ /•+ 



-ki n inru /r^o /^rrnr-^ cat 



4 r> rr^ n -^r\yvi^ 




n o J?; no 
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Age 13 



score Boint PR (Personal) 



7^ 



Cjit^ /9n4P^ 





AC 





sum 
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Age 13 ^ 
axfe Point PR (Cont.) 



l^i^ ^J/L >dnyj: lu^jfj, yyi/(XA ^ti. ^ynu 




^^^^^^ t^^^ ' 





Age 13 



\ 



Score .^int PR (Conti) 
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(Continied) 
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Age 13 ' 



Scxare Point PR fC< 



/rnaJ^s n^JAJ Hn^A ^/^ynPi^aj. 




jAslL Jbjaa ccqoda !l^Qoi?- nr<A^ 
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Age 13 

Score Point EM (Bnotional) 



•\rVJjrX^ -vp^yiij -Uiv^v)! a JrouA tJL k^Ui^ofco-n . 

La. Jm. a. y^^'O^ , 
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Age 13 
Scxare Point EM (Cont.) 






\- ■ 

\ 
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ERIC 



Age 13 

Score Bolnt RT (Retelling) 






WZL 



5s 
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Age 13 
Score Point RT (Cont. ) 



^^^^ -^^^^^ ^Jr^^^^ ^^.j^ ^^J^.^^ — >s ^ i*^^. 
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Age 13 
Soora Point FT (Cont.) 



^■Kf njv^rrs±. ^rr\A u^^lL aHj^ 

TyAcTN ^ Qj:ijfL^ l^irwK ]r\mrfVt ftiJtir. 

y\ KftL-fAv n^ii/v^ -r> Aj,. t\k g/ir\ — 1± tW^xA . / 

gLu u-A^M ^^>^itr^ Aj>-vyv^ ^ / "IZ&iA 



Age 13 
Socare Point FT (Cont.) 




yJjML^ .AJjJ O^^. '•Aj^JJ-' LLhO^ 
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Age 13 

Score Point IN (Inferencing) 



■1 -Uy/rv^k. -eli?, 





VU.a5. 







(Continied) 
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Age 13 
SooTB Point IN (Cont.) 



Age 13 
Score Point IN (ContJ 
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Aigtt 13 
Soora Point IN (Cont.) 



ly fill^ <k^Ary /Ht-^y -far ^A^A 



^s^Ar^4/ A/ArS(J? //p^^^eA^ Aau/^ A/y 
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Age 13 
Sooira Point IN (Gont,) 




/^jj- tjjfjJ ^^ ^ryjrj^j (^Jxpyy. 
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Dcu:L ijjflait faiMMst* kAm< Afflf^if' tCtj-.ii'rM 



.&aa3i^2 



(yiX^ jf-jh ± gj/^A^ Y tjr[6Afsff^. (cA J 0<iAt^ ) 
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mm u 

' Soopa Point CJN (Gont*) . 

ill tlvvnvlf. iWA A'lQ ^ puayJo. 

V)ifdf \fcT>\^'iEa fltti -dvt uibijji <Qnvq^ cit.d. 
J^^tliAQAtL^■J3ki>ix. QA8^ /x lir?t' tL , lot lifAii jt^B^^j 

! . ■ • • ' ' 

I 

./M jt^ "tA* l/Trfc^M Ttfe^ « ^^^^^^ ty-uiit^^ 'fl^ . 

-itL^ -tJLl -Ojdt ±k^, 
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Age 13 

Score Point AN (Anedysis) 




'tJjXSinL u>acWt cjO(>vdZ:!^ Q/O 





Age 13 V 
Score Point AN (Cont.) 






q/mmimq 

h t m . 



/I p ^ ^f\ ^^^^ f- ^^^^Q^^^ 



7q 



\ I 
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Age 13 
Score Point AN (Cont.) 







2 






,/1 Q. C/V 



— - — ^ jfcn — ■ ^ 



(Continied) 
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Age 13 _. 

Score Point AN (Cont.) 










7' 
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Age 13 
Score Point M (Cent.) 



(S^ t^artfji Vs^nA ^ ajVva tn;nr\\rsg az^3^ 



^VoffN Linur ;& rNA V^Qry^^^^■ 
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Age 13 

Score Point OW (Other Vbrks) 



"i-J'iJ^ ^^^^^^^^^ 

>*vt^<vtijj ^^^^^ ^^^^*^y ^'"'''^ 

^ r^ /^'t .Jj-^ye. .^^JJ^l ^ 




/x> >AC>Qp o-pS/ia^ /A^/TU^MW^^^ 



70 



Age. 13 
Score Point 6w (Coht. ) 



ALg^Pi (^Jb :g7Ug 






^^^^^ 




(Continied) 



Score Point OW (Cont.) 




^^^^ :t^y( 1^1A± Mie^n 




( ' 

V 




/id r^^TTJ 
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Age 13 



Score jpoiht 1^ (Evaiuatibnj 



i'+h(^Sjb^Jhi)ilfiiPi&y Q^A (\Sff^/Yifi .+f\ijJi 




\ 

#4 



Age 13 

• Score Point EV (Cont.-) ' •' 
^ >t V>T <^ ^^^^^ 




Jge 13 . ■ 
Soose Point EV (Pont,) 



^ p p . - J. w. » >^ "J ' n I ■. ■-s .i rf ' 1 4 



'tjf\mj^g tg^\U\tVj f^^^ 



\ i fir> >runruA,j^ hiV Wo, -tV\r7_ b/\^ 
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SCORING GarDEyi-RESPONDING TO LITERATURE ' 

General Responding 
"Somebody* S 'Son" ' 
H-402000-B1B-2,3 
Age»17, Package 9, Exercise 4 

gene ral Scoring Rationale ; There are several major ways to 
deegen^^under stand ing of a written work. Respondents 
lean use awareness of emotional impact, personal 
experience and knowledge of other works to interpret, 
provide meaning, evaluate and analyze the text. A 
content analysis of the responses not only provides 
information ^about which' internal resources respondents 
tend to draw upon to help their understanding of 
written works^, but also the cognitive skills they 
choose to demonstrate when given an opportunity to 
respond freely. It is expected that the results may be 
highly text dependent. : Al so , the better responses 
should move beyond plot summary arid retelling to 
Iprovide meaning, evaluation: and particularly analysis. - 

Sc orir^g Guide Cat^egories ; 

Descriptive information: Code each type as present or 
absent. Code dnie type as predominant. 

Efp = Egocentric . Responses ari3 not text based, but 
J are text relevant. Respondent writes a letter or 
\ story of his own or v^r^ites another story/(or 
excerpts) that he has memorized. Other types 
\ of statements categorized here are: "I never 
read stories"; "I*m not good with stories"; or 
; "I*m sorry to run out on you, I don *t want to go 
- ' to college either." 

PR = Personal — analytic . Respondent gives personal 
reactions fo content in an analytic sense — 
identification with characters, judgments about 
\ actions o f c haraQtens and ad v ic^ g iv ing , 
observations about the /way society should/does 
work. Respondent states, for example: "I/might 
have done the same thing," "David shouldn»t have 
left home," or "Hopefully his father will tie the 
cloth on the tree." I , 



V 



so 

76 



Personal — global , Respondent gives personal 
reactions to genre and content in a global sense. 
Examples would be statjements of the following 
types: "I like stories about nature," "I wish I 
,c6uld write stories like thi's/'^or "This is not 
my 'kind of story, .-.^Z...^ 



Emotional / Re spo nd en t 
feelings of mood to the 



ttr ibutes emotions or 
^xt or makes a direct 



statement of emotion. e^camples would include: 
"The story was fead /• "It's touching," "It had a 
funny feeling/^ "It was vVcT^i^atic ," or "I 
felt sorry for the boy." 

Retellin g, Respondent summarize^ or retells the 
story (or parts of it). tHIs can include 
statements referencing specific words or lines. 
(Disregard inaccuracies. ) 

Inferencing . Respondent goes beyond the .text' and 
provides motivations for characters or develops' 
action. It includes text-based hypotheses of 
.what did happen, or predictions about what will 
happen. For example: "David learned a lesson," 
"David's parents needed him to pay the bills," or 
"David feels that his father doesn't love him." 

Generalization . Respondent derives general 
meanings from the story, such as: "Go out and 
try new things," "It shows that people have 
feelings that can be hurt and people are the ones 
that hurt each other," or "Everyone knows i you 
can't run away from your problems." | 

Analysis-^superficial Respondent mentions 
superficial character istics of the text. iThis 
includes concerns about format, for example: ( "It 
could have more details and not so many, long 
words," "I -didn't see any misspelled words," ' I'lt 
wasn't long enough^ or "The author ; I upes- 
imaginative language.!' \ 



an 



Analysis — elaborated , Respondent gives 
elaborated or sut)stantive discussion of ariy one 
of the following special features or literary 
devices: plot, characters, setting, images, 
sounds, etc. Included here are discussions of 
plot veracity and meaningfulness . 
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OW = Other works — general . Respondent classifies the 
work as to genre or -type and compares the story 
to other types of works or art forms in " general , 

for exSmm: "If s not^ Uke a story -I ' ve seen 

before," "I think it's a good soap opera," or "It 
is like a myth," 

2 5;/ othef' works — specif ic . Respondent compares the 
story to i spec"i f ^ • work which is mentioned by 
title, such as: "TPV i^^^^t paragraph reminds me 
of an old song, 'Vie a Yello. ^»^bbon 'Round the 
Old Oal^ Tree. ' " 

EV = Evaluation. Respondent ' judges the worth of the 
work. TH'is* also includes such statements as: 
"It was stupid," "I didn't like it," "It doesn't 
make sense," "It is nicely written," '"It was not 
exciticrg-'or sad," "It has no meaning ," or "It is 
imaginative." 

NOTE: In addition to the papers which were considered 
rateable (1 = rateable) and which were analyzed using 
the categories described above, some, papers were net 
considered rafeable and these were placed in v u^ 
following classifications: 

0 r No response . 

2 r Nonrateable . Copies or circular. 
7 = Illegible, illiterate . 
8. = Totally off task . 

9 = "I don' t know." " 
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Age 17 

Soore Point EG (Egojexitric) 



bg^Aru^f^r.io 4ir^'t-tA^r^ o-Ov/QfiL^ hp. tk^CT^ 



U^obJd, ^^A;u\-tv 4cjOr>€l^ d^^tx± 1rv\F Qj^dy 

Lfl t)jg 



- ; ' \cNe Ycu"^ ^o ni 



. .. g-Q?- • , 



ERIC 



Age 17 • 
Scx>re Point EG (Cont. ) 



fJtiAilL AmA uAJ: (TiK arUt^:^ (rut A 



Jam (>Ajii: ymrnu^ J) JuxA ^^^aJ 





IT \AJ*'itc.S )^w%^«» . Titers h» t^ejjX- ~Sr "ttrs- 
ppy/ygiT ^UtUAktcC i»\ S^^^if/ uorc^(^^ cUA^^£ I 



^ 
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Age 17 

Scxjre Point PR (Personal— Analytic) 



0 JkJLef :^ j^gxJ:^co-vn c*^ Gc ^^tO^ 



i>/i»^ Q-XhO to rJLCux nn ^uj'tj^ On.ukl 



(Continved) 
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Age 17 
Score Point PR (Cant.) 



«•••••• 



r.^^ t?^-^ — 
,J^c^^J£ , JJ>^ ^^^^ ^n^^^^ — — _ 





.fiU<(''<^Uay^'h ; — '■ , ■ ■ 

82 



At^e 17 
w Point PR (Cant.) 



3: -C^^t -VW JCiC^ x ^^'S Q /q6 



r^/g^a rA/y\/c y'v^-^/g /tjatr 

/W^. ^ 
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Age 17 
Score Point PR (Cont.) 



,n:u~<^ ■-'f^A4- ^v^^.^l/^ -f/eenS 
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Age 17 

Score Point EM (Emotional) 



l^nJ^ .Ifja ^ jPofMi f. <L rfinie. Pjoah^ ^ 




MM. 




'it 




\MM \±*& thdCtKli^ Hu/rh 



(Continieu) 
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Piqe 17 
Scaxe Point EM (Cpnt.) 



\iilw\ rmifff OftL^.lp. iMff)^ . — L — 



/ rousy^^ y^/9 y^ fsr^-r- — ^^^^^^^ — ^fc^ 




VagLH.g^kgA '^IA>^c^ VtfAli>^^^jv "^H^;?, 
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Age 17 
Score Point EM (Cont.) 



4^ 



C^pA^ixuA ^/nrrJt /yytJt^ '^AaM _^^^f , 
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Age 17 

Score Point RP (Synopais) 



UL 



f^. jr)AU^ 4kid- .»uJ±^V\^ uiOW^ Ua^^ 

VaxKlr\<^ ma^Uju/i -Hu^ uu^Ia VAnrr\ <La Llo 

Ujfc<u»M^L uiA^ d^Jj^^ 4i L:<i JitKi< t 



£^ " __ 

0 88 Op « 



Age 17 
Sc»re Point RT (Cont.) 



AA Ll. t,^^J2 Jk. y^^^f. CiJ^.i» 




- 








S3 
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Ag« 17 
Sooro Poini; RT (Gont.) 



^^^y^ 






li 
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Age 17 

Score point IN (Inferanaing) ' 



.44 A;4jfcf/i ^ 







71,- 



Li 



1 
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i\ge 17 
Score Point IN (Cont, ) 




Hif i^^^^-' "^nAtj^ YldtAijnJs 



Jn ^0 7k7^^/g- — ■■ — 



sr.- 
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Age n 
Scare Point IN (Cant.) 



— » 








ui ta^ ■ 



07 
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Age 17 

Score. Point (21 (Generalization) 



94 > 



Age 17 
Soose Point (31 (Cont.) 




m 



fjj^ JaJ tZiui 2$" 4 





995 



Ago 17 
Sooxre Point GN (Cont.) 





\ 



loo. 
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Age 17 
Score Point ON (Cont.) 




•40 



f^^^^ ^.Aa^*^J^ AJeu^a^ 



^^^WA^ j^ /p^^ ^ ^^^^ ^ M/ 






? 



1 



m 



y Age 17 • ■ 

Scose Point AN (Analyala— Svfierf Idal) 



AuTHor fi/a AAtr usr (fbLoitfot. ms(iJF^7ity»s . TTr -TO^ — L 

pau./o At LTAisr^ g^vo^fg ^g/vy /'jljait fiM\^Aira ,A/7b 

Tuasx ftcJ ^/3AvA<^jfAOik^ -nTJ M-fggT LTAMMo auyji /or aF QevtiL, 

»f/ -rurr r%/^ j*^^'^ aP 'f^A£A^ siAyVv^AMZ^.-^ 

S/\tn , C J 
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Age IT 
Soon Point AN (Cant J 






1 
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;vgi 17 
SOQKV ^nt AN (Cont,') 



l^i^ I ✓[ ^rnrk^ , /lit jig — "SSt^ 




Soon Point CM (Othm: Vtovki«><-(3«niral) 




^JjsL^^ — : — ■ \ ' ; 



. Win 17 ^ ' 
Soorii PpiJit BV (Evaluation) 






i^W4' yNw\[ \^(V<i 



MO. 



Soon Voint BV (Gont,) 










V . 103 
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tifay* 






Jftia^ Jim 




m i^ c^ , - — - 




Ag« 17 




\ 
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Age 17 
Score Point X CContf) 
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' Age' 17 
Score Point ,X (Cont.) 



WTA ^jpHjrr -iHvp )n^K V^v-^ r/^org tn> : vym-^ 

(y^^ 'Tj- AppKi W-. rsgayV tWv^h . / 



Ag« 17 ■ 
Score Point Y (Analysia-^labotated) 



* 

arf, ^i^aX p^jjid. jo^^d 



MtlLq . . ^-—--.^^-^^ — 



112 



i 



r 



108 . . ,1? 



° Age 17 

t 

Score Point Y (Cont.)' 



• • # • • 




■ -v . (Jii& ''W^'^i£\'t ' Ctrl'- . ' s' U:;/?^'; " •■^''^>*^W'7-.v ; 
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Age 17 
Score ^int Y (Cont.) 



^,^1^X f ^^/^^^^J, ^ -^.TTi^. .Qg=Vr AtrtH^Ji 



Age 17 
Score Point X (ContJ 





mi 






Age 17 . 

Scxare Point Z (Other Works— Specif ic) 



l^aflll ^^if ) fiflKrrJj >^ yr-^/^ ^ 




J ^ 



_J., 
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Age 17 
Sooxe Point Z (Cortt .) 



^^^^ ^ ^r. ,'Ji^ih 46 . 



4im A^. 
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•Age 17 
Score Point Z (Cont.) 



lifji . )r\^ ,.>n^t< -A. rtix^i iJ^-» ^ H.'^ fr^t^l dhA^ 



v 

■ \^ 



\ 



erJc 



Age 17 

* 

Soore Point iCont.) 






H-406000-BlB-2,3^ 

Read the story which begins below and then answer the questions on the four 
j^Ages following it. ^ , " 



A Stoiy of a^Godd Doy 



A man I used to know very well told 
me this story. He was a very truthful kind 
of man, fant he used to elaborate things 
more than a bit, and perhaps he elaborat- 
ed a bit oh this. 

Everybody, said he, has a best cat or 
dog that remains in the mind when other 
very dear memories have faded, and one 
says with complete assurance: •'That was 
the best dog.^ There were Tommy and 
Gu2zle and Spot, and they were all such 
good dogs that it is hard to believe there 
could be any better, but my best dog had 
not got' a name at, all; he answe^ to a 
very_ low whistle. He never barked; he 
neverlnacte :any noise of any kind; except 
that, now and again, he gave a kind of 
whispered gargle away down in his 
innaz^ls— you could hardly hear it— and 
that showed the top of hiis^elight Poor old 
fellow, he hadn't much to be delighted 
about: he was fust deliglUed^to be 
delighted, v. - . ^ ' > . ^ 

This is how we met It was evening, 
and I was going up a street and down a 
street. I was looking- for something. 
Among other things I was looking for a 
job, but this time I was looking for 
something else— and suddenly I saw it It 
was in a doflfs mouth: it nearly half a 
loaf of bread, anid^the^^ slinking up 
an. alley with it He^'^i«nw ;a^^ 
. kind of dog, and I began stalldhg him for 
my slww^pfr^ 

hlm.i to ^iheir:end^ of thef ^ey, 
whispered^: a(few j^ Ibw 'lBruntslat me. 
^Drbp it,%:saidy I^mndt he;:droppedf it 

Hemt down^atfew^steiM ainfi^^and he 
looked'i|^ihe|l)rera^^^ 

and'tKen'^:he(s^ then 
he lobKed at the bread ags^n/l broke ^^t^^ 
halMoaf into fairly even pieces, and I 



handed him the larger half.. He looked at 
me, and he looked at the bread, and I 
could see that he was ^trsring to work out 
where the catch^^as. Then he scratched 
himself with some fury, and when I began 
to eat he began to eat He would stop 
every now and then to take a good look at 
me, and then he made that curious, 
whispered gargle of delight away down in 
his innaitls, and then he started again on 
the bread. 

How good that bread was! I 
remember Uiinking that cake was not half 
M delicious as: bread, and that t^ 
was the beM that ever was baked; I could 
have eaten a hundred loaves of it, and then 
^ I could have c^ten the^ d^ 

\ It ; wu :eve^^^^^ darkish, so I 
hunched mysielf up;f^^^ I 
was^ and the dbg^^l^ to 
.^me; aiid^ at last ti^tened , himself up 
against me, and he^gargl^ a little and 
scratehiiedihimseff n^^ 
care afaiout iEmy^ I Hadral£nend; and 
he cared l^,i for he had a friehd^too. 

In the mbniihg^ saw. what all the 
scratching wais abo^ He was covert 
from head to foot with mange. He was al- 
most a solid mass of scabs. One of his eyes 
was blind. He was about three years 
ryounger/than I was— that is; he was 
rati|ier old, and he looked at me out of his 
one koodish eye with the kindly adoration 
*that a good dog r^rves'for its best pup. 
He- knewj^^that L^as an incompetent 
person, and he was very glad of-that for_ 
he had made up his mind that he would 
feed m^ by day and keep me warm by 
night 

It^ was winterish, and rainish; and 
darkish, and we wandered,together up a 
place and down a place, and we kept 
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wureftilly out of everyho<iy'8 way. I didn't 
want pecf))!^ because th^ wouldn't give 
me a'jfiyb, and Ke didn't wtat jwople be- 
cause th^ heiiyed rocka^ at him*. 
^--JPorjnore than two jnonths, whatever • 
I ate he;^roui^it:m9. He was mamlow^ 
skillAil., He knew whe^ bits of bread 
grew. Sometimes there wasn't any, but 
mosl days there was a bit I should have ~ 
been very hungry, but in those days tny 
mind ;nioved;arpund at about a mile a 
minute and it ,ha^ stomachs. 

One mbi:riing£^|ipod doiir set out * 
hunting.as iuujUAThen;^h»(Hng gone but a 

pturiiedr^htiv|^^|^^g;|7ll^.,h^ 



mbvMl awt^/ 
And thetiT, sii 



lf1ii|Vh(lad,to 



theskga^i^liagi^l 
everAK«£M£«^illi!iHi|hlf^^^^^^ 



FatsoundtBhad 



.bearalmmimate;^^^ , 

howIedfMltpoughihe)^ 

my iirin#f gil^^^ |iim, 
^d as I lobketl^iintb his face I saw what 
;;-:was::w^ 

; His bther eye was gone. He was quite 
blind He couldn't t^;hu^ting. He wasn't 
howling «]bput":hin^ howling 
because Hecpuldn't nowout soniethingfor 
me to eat He cajnedji^^^ abbut himself 
than I, at that moment, cajred about me. 
He wanted to howl himseif dead, but my 
arms coaxed him, and in a little while he 
stood silent and shivering. 

I picked him up— he was not a light 
dog— and I; walked and* walked and 
walked. There were fields on one side, 
with ajdull sky over them, over us: , the 
world wais'a:l)0Xf and we^were two rats in 
a trap. I cune-to a snnuUI pl^^ and sitw a 
druggist's shop in it; the door was open. I 
put the"^ dcir down behind the door and 
walked in. There was a man— perhaps ten 
years older than I— behind\the counter, 
and I said to him, ''Please, wilfybu kill my 
dog for me, without hurting himr 



He was a hard-faced, tough man, and 
he looked me up and down with eyes that 
' were Jike btiIIeta.H 

••What will you pay me-withr said he. 

''I have ho money,'* I answered. ' 

Tve ncrpainless poison,'' said he. 
. I look^ at the rows of tottles^on the 
counter ancl on the walls, and my next 
words were inspired; they were even 
crafty. 

**You are a very wise man," I aatd. 
"^ere is nothing of this kind that you 
couldn't do.-" ^ 

^* ' His eyes becune ey^ agaiih 

Whaf s wrong with the dog?** saitfhe. 

.''He is old and blind and dying of the 
mangSs.";-* 

"Where is the^ creaturer 

I pbihteclland he went to look. 

''G<»a|,G<id^^^ighty,'' said he, as he 
stared at^thelcroucW^^ Take/that 
thing .away.7;:iE^>\i.^^^^^^ • 

I foilowe^ihim into the shop. ' 

"Listen," said I, "tiiat is the best dog 
in the wQrld* He has fed me for over two 

months." . . 

' Tou ate out of that thing's mouth?" 
said he.^ ^ f ^ 

"Yw," I answered. "Hta went blind 
this morning, and h0 is dsing of horror 
becawie he can't feed me." 

The man look^ at me as if I were 
cnuey. 

"You know how to do everything," I 
said. "Do this for the best dog in the 
world." ^ ^ 

He turned briskly^ took tip a pile of 
papers, and placed them on the ,floor. 
"Stretch him on that" he ordered. I 
picked^mydogup— he was all one jelly of 
trembling terror.. ' 

The^ man went behind his counter, 
and in about five minutes he came back 
again, cairying a bowl. 

"Good God!" said he, as he jooked at 
the dog, and then his fiice went' gentle. 
"There is warm milk and bread and 
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sugar^ogs love sugar,** he added, ''and 
there is just enough of something else that 
will end his 

I |mt the bowl to h^vv^ dog^s nttse. He 
smelledt^ M smelliki s^in, ami ^en, 
with an-astcmisbing 

4md eat while I petted him^ He was tasting . 
a ftin4 of fb(xl tfa[£^ hadn't 
t^tecl for six or seven years. Not since hi9 - 
master of lprig ;ag6 hid thrown him out, 
and flung'it>cks at Jiim till he left 

**Xake liim down to 'the nelds,** s^ 
the rAan.^'H^l begone ih^^l hiailf 

hour.''^^;' ;■' w;,:v . -^^^'rfV ; - ■ ■ : 

ISo i^'amoi^ 
and be begm iioin^^^ 
he began to:Jtjf *'^leSp^^ 



waken up, and he began to gargle joJffuHy, 
and^then he began to forget these things, 
and all things* ^ 

He forgot blindness and age and fear. 
He forgot hunger, he forgot me, he forgot 
to scratch himself, he forgot life itself. He 
.stretched himseif a little, luxuriously, and 
then a small shiver ran all oyer him, and 
he was' gone. . 

I pushed him deeply into th4 bushes, 
and walked awajr, pretty loneljrs^ buf^ 
I think you Will as^ee^ he 
wias my best) dbg, I^ am not making 
.mistake in that very important matter. 

Shortly after that I got a job-*said the 
man who told me this story. 



A. -How wa* .ii deatk.of the dofig dtescribed? 

o As viotent sind fearful ' ^ ■ 
CID As*painful and lonely , 
; \ As painless and peacef^^^ 
G As elaborate and ceremonious 



CD I don't know. 
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t 

F. What emotions and feelings did you have when you read this story? 
Describe your feelingrin a few words on the line be.low. 

» 

■■ " 5 '■ ~ — ' — ■ — — ^ '• '— 

-G. What was it about the story that made you feel the way you did? Write 
your answer on the lines below. ^ 




STOP 



DO NOT CONTINUE 
UNTIL TOLD TO DO SO. 



HASP Ho.: 
Exetcise Type: 

Passage Type^ 
1979-80 Objective: 

1979-80 Subob jec tive : 

NAEP Scoring: 

Ages «r 
National Results; - 
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Parts a/b^c;e - Hultiple Choice 
Parts F#6 - Open Ended 

Literary / Other Prose* 

PartB A,C - Conprehends written 
vorks ^ * 

Parts B^E^F#G - Besponds to 
written vorks in interpretive 
and evaluative nays 

Parts A,C - Comprehends textual 
relationships ' 

Parts B,£ - Analyzes written works : 
Part F#G - Deaonstrates awarenessi 
of enotional impact b£* written ^ 
works 

Parts A,B,C^E - ^lachine Scored 
Parts F,G - Hand Scored 
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source Information: Story of a Good Dog** as 

reprinted in SEA GBEEN HORSE 
edited by Barbara Hoves ' and 
Gregory Silth vas originally 
ptibliahed in JIHES, SEOHAS AHD 
JACQOES, DNFOBLISHEO RBITINGS OF 
JAHZS SIEFHEHS, edited by Ubyd 
Frankenberg. Copyright ® 1964 by 
Haceilian Publishing Co., Inc. 
Copyright ©1962, 1S64 by Iris 
Clare , Rise. Reprinted . by 
peraission of Hacsillan Publishing 
Co.f Inc* 

* Ihe range of response percentage values listed for the 
open-ended portion of tt^is exercise represent bqth 
acceptable responses, which are aarKed vith an asterisk 
(^) , &nd_ unacceptable responses (all others). In 
addition, the .score points marked vith the second 
alphabetic codes (C,F,SR or N) refer back to the second 
and third categorizations on the scoring guide. 
c«content, F«fora, SR^subjective reactiour and H^nuaber 
cf pieces of evidence . For convenience , score points 1 
and 2 Jiave been coabined into 1, and score pcints 4 and 5 
have been coabined into 5^. For exercises without a 
score point 1 on the scoring guide, the percentage value 
for score point 1 on the docuae station .page consists of 
responses froa score point 2 only. 
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SCORING GUIDE—RESPONDING TO LITERATURE 
EXPLAINING RESPONSES TO LITERATURE ^ 



Emotional Responses 
. "Good Dog" 
H-406000-B1B-2,3 
Age 13, Package 13, Exercise 6 
Age 17, Package 13, Exercise 10 



General Scoring Raitonale ; The responding to literature 
objective was HPormulated to address "deliberate, 
conscious kinds "of interpretation." It was hoped that 
respondents would not only be aware of their feelings, 
but be confident .about expressing them. Thus, a 
successful response would both identify an^^ emotion and 
articulate the characters, events apd ideas from the 
text that contributed to that emotion. Evidence can 
also be provided from personal experience, other works 
or special aspects of the construction of the text. 

NOTE: Rating should. In general, be "done by taking the 
entire student response into consideration without 
regard to what is actually written in' the space 
provided for the first part and for the second part of 
■ the response. If" reasons (substantial) are given in 
\ the first part they are valid. The same is true for 
\ emotions or feelings identified in the second part. 
1 \ Caution should, however, be used, as this often leads 
\'\ to a tendency to rewrite the responses. 
1 Categorizations should reflect, as closely as possible, 
I \ what respondents actually wrote. * 

Sclori\ng Guide Categories : 

1 \ ~ . .- 

I. First Categorization — Identification and 

\ substantiation of personal emotions and feelings. 

\ This takes into account both open-ended' parts. * 

\ ^ V 2 Unable to identify emotion or feeling . 
Respondents do not do the task. They refer to 
the textv' but do not answer even the first 
question. Examples are: 

Av Some material is quoted from the text with 
no clear Identification of the respondent's 
feeling or emptidn. ^ 




B. An emotion expressed by a character la 
Identified rather than the respondent's own 
feeling I for example: ''The man was sad." 

»' . ' 

C# An observation about the story is madei 
such as: ''The title is misleading." 

2 s Emotion or feeling A identified without 

substantiation . Respondents name something but 
cannot go on. They identJLfy emotions , and 
feelings but do not substantiate choice with 
evidence from the text. Resjpbndents tend to 
provide: 1 ) circular eyidenoe such as: "It.' s 
sad because it's sad"; 2) a copy or close 
paraphrase of the text; 3) vague reasons like 
"The way it sounds," "The way the author wrote 
It," "The words used," "The way it is made"; or 
4) only a subjective reaction as 
saabstantlation. v , 

3 s Emotion or fejpllng Identified and substantiated , 

with minimal evidence . Respondents laentiry . an 
emotlonX s} or feeling (s) and substantiate their 
cholce( s) with only ^ one reason or piece of 
evidence related to.^the text. 

A. Reason can v be directly 'related to the text , 
for example: "It was sad because the dog 

^ died." 

B. Reason can be ;inf erred from the text, such 
as: "Sad because the dog was his only 
friend." 

^ ■ ' ' ■ . • ■ ■ 

C. Reason can be Inaccurate, if it is related 
to the text. 



D. Reason can be based on personal experiences 
or opinions that are related to the text. 

. E. Reason can refer to (but not retell) 
specific places in the text, such as: ^ 
"Because of what it says In the last 
paragraph." 

NOTE: "Sorry for the dog" is Identification of 
feeling/emotion. "Sorry the dog died" is 
identification and minimal substantiation. 

4 s Emjptibn H or^^^^^^^^ Identified and 

subs.tantlated . Respondents identify emotlonc sj 
- or feeling( s) and substantiate- their choice( s) 
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^^^^ at least two reaaons or pleoes of evidence 
related to tne text. However, the evidence may 
be presented In an ambiguous fashion or be of 
the typus described Iri 3C-3E. Reasona must be 
dlstlnotr-not Instances of the same reasons as 
In **(Sad) because the dog was starving and 
hungry." 

5 ^ Erootlon or fe'ellng Identified and aubatantlated 
In a coherent _faahlon . Reapondents Identify 
amotionta) or feeiing(a) and^ aubatantlate their 
choloeCa) with at leaat two reaaona or plecea 
of evidence clearly related to the 
text-- directly related or car? be readily 
Inferred. The reaaona are preaented logically 
and coherently. 

NOTE:. The following typea of papera were 
claaalfied' aa :hidlcated and received no further 
acorlng; 

• 

0 = No reaponae . ^ 

7 = Illegible or Illiterate . 

8 = Totally off- taak . \ 
^ s " I don* i know ." 

II. Second Categorization— The aource of the evidence. 
Code preaenqe or abaence for each of the following: 

1 Gonteht v The eylderice la baaed on/the content 
o f ^ the text , a uc h a a : "The way the dog waa 

- ■■■■ mop.tng;v''v.;;' 

2 s Eorm v The evidence ia baaed on the language, 

atyle or conatru^^^^ of the text. 

3 = Subjecrtive r^actioha > theae are reaponaea that 

jjudge the worth oT all or part of the text, for . 
example: "I don^t like dog atorlea," "I hate 
to aee a dog dead," "It waa Intereating,^^ 
"It waa^ monotonoua." about 
the actlbna of the charactera t>r peraonal 
experiencea may be atated, auch aa: 7^1 had a 
dog that died" or referehcea to^ the moral of 
the /.atory or general ph^lloaophical atatementa 
mayabe made, auch aa: "Accept the death of 
your dbg," or "Death la a myatery." 
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NOTE: Content and form can be .present only If 
primary categorization is a "3" through "5"; 
subjective reactions can be present in papers 
categorized "2»» through "5." 

III. Third Categorization -'-A count of the number of; 
reasons or pieces of evidence. Categorization for 
the count of details is as follows: (1), (2), (3), 
(4), (5), (6); (7 or more). NOTE: This count only 
applies to papers with primary categorization of 
•'3" through "5"; subjective reactions should not be 
counted as reasons or evidence. 
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Age 17 
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Subjective Itoaotlona 
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Read the story w^hich begins below and then answer the questions on the 



thr^e pages following it 



One of these Days 



Monday dawned warm and rainless, 
Aurello Eacovar, a dentist without a 
degree, and a very early riser, opened his 
office at six, He took some false teeth» still 
mounted in their plaster mold, out of the 
glass case and put on the t^ble a fistful oi 
instruments which he arranged in size 
order, as if they were on display. He wore 
a coUarlesa striped shirt, closed at the 
neck with a golden stud, and pants held 
up by suspenders. He was erect and 
skinny, with a look that rarely corre- 
sponded to the situation, the way deaf 
people have of booking. 

When he had things arranged on the 
table, he pulled the drill toward the dental 
chair dnd sat down to polish the false ' 
teeth. He,seemed not to be thinking about 
what he was doing, but worked steadily, - 
pumping the drill with his feet, even when 
he didn't need it ^ 

After eight he stopped for a while to 
look at the sky through the window, and 
he saw two pensive buzzards who were 
drying themselves in the sun on the ridge- 
pole of the house next door. He went on 
working with the idea that before lunch it 
would rain again. The shrill voice of his 
eleven-year-old son interrupted his con- 
centration. 

VT-apa." 

"What?" 

"The Mayor wants to know if you'll 
pull his tooth." 

"Tell him I'm not here." 

He was polishing a gold tooth. He 
held it at arm's length, and examined it 
with his eyes half closed. His son shouted 
again from the little waiting room. ° 

"He says you are, too, because he can 
hear you." 

The dentist kept examining the tooth. 
Only when he had put it on the table with 
the finished work did he say: 

"So much the better." ' 



, He operated the drill again. He took 
several pieces of a bridge out of a card- 
board box where he kept the things he 
still had to do and began to polish the gold. 

*Tapa," 

^•What?'* / 

He still hadn't changed his 
expression. 

"^He says if you don't take out his 
tooth, he'll shoot you," 

Without hurrying, with an extremely 
tranquil movement, he stopped pedaling 
the drill, pushed it away from the chair, 
' and pulled the lowc^r drawei? of the table 
all the way out. There was a revolver. 
"O.K.," he said. "Tell him to come and 
shoot me." 

He rolled the chair over opposite the 
door, his hand resting on the edge of the 
drawer. The Mayor appeared at the door. 
He had shaved the left side of his face, but 
the other side, swollen and in pain, had.a 
five-day-old beard. The dentist saw many 
nights of desperation in his dull eyes. He 
closed the drawer with his fingeVtips and 
said softly: 

"Sit down.". 

"Good morning," said the Mayor. 

"Morning," said the dentist. 

While the instruments were boiling, 
the Mayor leaned his skull on the headrest 
of the chair and felt better^ His breath 
was icy. It was a poor office: an old 
wooden chair, the pedal drill, a glass case 
with ceramic bottles. Opposite, the chair 
was a window with a shoulder-high cloth 
curtain. When he felt the dentist 
^ approach, the Mayor braced his heels and 
' opened his mouth. 

Aureiio Escovar turned his head 
toward the light. After inspecting the in- 
' fected tooth, he closed the Mayor's jaw 
with a cautious pressure of his fingers. 

"It has to« be without anesthesia." he 
said. 
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'•Why?'' 

**B0cau80 you have an abscess/' 

The Mayor looked hinri in the eye* ''All 
right." he said, and tried to spiile. The 
dentist did not returi(i. the smile. He 
brought the basin of sterilixed instru*^ 
ments to the worlctable and took them but 
of the water with a pair of cold tweezers, 
still without hurrying.^'Then He pushed 
the spittqon with the tip pf his shoe, and 
went to wash his hands in the washbasin. ^ 
He did ail this without looking at the 
Mayor. But the Mayor didn't take his eyes 
off him. , ;^ V 

It was a lower wisdom togth. The 
dentist spread his f^t and grasped the 
tooth with the hot forceps. T Mayor ^ 
seized the arms of the chair, braced his 
feet with aUtM^ strengtht and felt an icy 
void in his kidneyi. but didn't make a 
soundv The dentist moved only his wrist. 
Without iwicorr rat^ with a bitter 
tenderness^ he saidr - 

•*Now youll iJay for our twenty dead 
men.** 

The Mayor felt the crunch of bones in 
his jaw, and his ey^s fllled with tears. But 



he didn't breathe until he felt the tooth 
come out Then he saw it through his 
tears. It seemed sq foreign to his pain that 
he failed to understand his torture of the 
five previous nights. 

Bent over the spittoon* sweating, 
panting, hjs unbuttoned his tunic and 
reached for the handkerchief in hjs pants 
pocket Thedentist gave him a clean cloth. 

**Dry your tears,'^ he said. 

The Mayor didf He was trembling. 
While the dentist washed his, hands, he 
saw Tthe crumbling ceiling and a dusty 
spider web with spider's eggs and dead 
insects/The dentist returned, drying his • 
hands. ^'Go to bed.'' he said^ "and-gargle 
with salt water,'' The Mayor stood upr said 
goodbye with a casual military salute, and 
walked toward the doori stretching his 
legs, without buttoning up his tunic, 
> "Send the bill." he said, 

*To you or the town?" 
,Thia Mayor didn't look at him. He 
closed the door and said through the 
screen: 

"It's the same thing." 



P^,^SE CONTINUE ON THE NEXT PACJE 



(Continuad) 

P. li this a good story? 
^ Yea 

CD Ko V 

G, What was it about the story that led yoy to choose the answer you did in 
Question P? Write your answer on the lines below. 

\ 



DO NOT CONTINUE 
UNTIL TOLD TO DO SO. 




1979-80 Objiotlvfj 



1979-80 Sabobi«ctive 



1 



NAEP scoclng: ^ 
Ages 

national Results: 
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Pact! AfBfCfOiBfF" 
HUltipl* CbOiQ« 
fast a • Optn lnd«d 

Lit«suy / othtc Pcoft , 

pacta AfB«C«Dil • coapcihunda 

WCitttO WOCKI 

pact 7 -valuta ctaaing and 
Uticatuca 

pact a' - Riaponda to witten 
WQcka Id intacpcttiva and 
avaluatiya u^ya , 

pacta AfB*^#& - Coapcahands 
textual calatlQDiMti pa 

Pact , ' I Coapc,^ban*« ■ ■ 

pcGpoaitioiialc^^ 

Pact f -^jrail«ai;i* of 

caadiag foe th4 i^^ ^ 

pact 6 -BTaluafaa written wocka 

Pacts A,B,C#D,B,y- Machine Scoced 
Pact G >■ Hand Scoced 
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04* 


A 


OU* 


B 


02* 


C 


02* 


D 


o3* 


E 


01* 


F 


00 


G 


01"^ 


G 


02 


G 


03 


G 


06* 


G 


07 


G 


08 


G. 


09 


G 


01 


GC 


01 


GF 


01 


GSB 




.197>-e0 , 
9tekft9« lx«coi«tt ■ 

Total Tilt in saaoDdflt 

8ouV0t Infocifttiont 



0705 
0S91 



••Out Of Shoft DAya" fvoa NO one 

NBIXI9 70 THB COLQNIl Aja OthOV 

stofiitif by QibffloX QaitqIa M<c9utv, 
tCADilAt^d fcol tbo Spaniaii by 
J* s. , Boenattin* . copyciglvt c 
1966 in th« ingXiah ttanaXatioih 
by Haspar 9 RoWf lubliahirar 
inof ' S«pcinta4|' by pacilaaion of 
thf pttbliabas. ^' 

* Tbt canga of caaponaa oodaa foe tbia axacoiaa baa baan 
9pndanaad aXigbtlyr a,o tbat aooca pointa 2 And U hava 
baan ooablnad into 2* and 9 and 6 'hava baan ooabinad into 
6*. 6* ia oonaidacad aooaptabia^ all otbac caaponaaa ara 
unacoaptabla* In addltion» tba acoca pointa aaipkad aa c, 
?, or .SB cafac back to tha sooving' , guida aaoond 
cataqoriaationa of content, f oca land aubjactlva caaction. 
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SCORING QUXDE— RBSPQNDINQ TO LXTSRATURE 
EVALUATINQ LiTERATURE 



Applying Orltsria to Evsluat* Storl«8 
'"On« of ThfBf Day0", 
' H-420000-B1B<3 
Ago 17 1 Piokago 7i Exorolso § 



qpnoral Soor'ln'g Rationalo i Sinoo tho objootivo roforring, to 
"■ tho •viXuStlon or writton works atatos that "It la. 
Important that raadora bt ablo to artloulata tholr. 
orittrUV raapondonts sihould txplain tht rtaaona or 
orltapia for thair tvaluatlon. To be auooaaaful, 
responsfta ahould provide examplea from j^he text that 
relate to thoae criteria. Plot aummary oan be viewed 
as minlmaX aupport for various oriteriai however, the 
best papers should also oonslder suoh aspeots of the 
.text 'as setting, plot and oharaoter development, 
raianing/measage, olarity of language, relevance or 
, believ ability. 

Scoring Guide Categories ! 

1. .Fjl.rat Categorizatlon r-Preaentatlon and elaboration 
of evioenoe, 

1 9 No . oriteria or evtdenoe given ; Respondent 

Qoples part of the text or gives a close 
paraphrase or circular response, such as: "It 
was good because it Was good," "I liked, it," ,"I 
didn't like it," or "I've heard it before." 
Nonsensical, or wildly Inaccurate statements 
_ ^ are' given J . ' ■ - ^ : j 

2 = Gives a vague or unelabQrated oriterlon .i A 

broad, sweeping generalization or • persbnal 
assertion is ''tnade, whioli. does not necessarily 

' have to restate the phrase "It was good/bad—." 
This response almost could have been given in 
absence of having heard or read the. story. It 
oould , 'apply to, •/almost any story. It 
was— exciting, inter/esting, had a good. plot,_ 

, and so on (broad i^ejneral adjectives) . 

3 s .Retelis or giv'es summary or one vague criterion 
■ WitW synopsis as\ evidence . The summary may 

refer to part or all- of the stOry; it maybe 
cryptie.or lengthy and well .written. This 
includes any citing of content of story (as 
long as itTs not basically copying) , 



zH s Gives -two, or more unelaborated criteria * 
fteajp^onaea contain tvro or more generalizations 
• or personal assertions. (These are longer 

5 s Gives one criterion elaborated with evidence . 

nesponaant gives one criterion, genar^iization 
or ptrsonal atsartlorr that la supported with 
#vidfnof 9th*r than rateXling or plot sumnarv. 
It way or way not ba aooompanttd by 
untltl^tPitif^ «f IliPla* (It was intf peating 
btoauat , . raapondant givaa somethlhg other 
than plot aumoiapy.) 

6 = Gives two er iter la elaborated with evidence . 

ResjK>n«iesfe " g Ives ' two^ ©V- ' more criteria » 
- generallzationa or personal assertions at least 
tw O j of Wilich are supported with evidence other 
thah refilling or plot summary. These may or 



critarla. \~.N0TEi Once a paper meets the 
orittri* Itatid foi^ a "ilj," "5" or "e" it does 
not mattar if that response is also accompanied 
' by plot summary* 

NOTEt The following types of papers were 



7 s Illegible or lllltierate . 

8 s Totally off task . 

9 s "I don't know ." 

Second GatfeJ0Pization* *Basl8 of evidence. Code 
fFSifiif'7il?lI|ll^^ e ach o f t he f o lie wijig : 

1 It content a Tht avldiind^ 19 baatd on the content 
or tne text, t^r at ample t ••Givea ari idea of 
the old wan •a way of life a** 



s Form e Th(^ v idjnoe la baaed on the language^ 
atyle or u> : >tru6tlon of the text, for examples 
J^It didn't 4.eem to have a beginning or an end." 







3 « S\x\iS9cttv^ r^ 

judge the wortij of all part of the t^xt, or 
' persdnai ' opinions, a 
/ characters rt^^ the 

i mor-al of the «to^^^ "I 
like fairy tales." / 

NOTt: Second categorization is only for papers 
with primary categorizations of "2" through ."6." 




Score -Point -2 

♦ ■ . ■ 

No 

■ ■ - .it- . ... . • . • " . 

iilin ,.iMTrv\ii — 

9 

I 
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Scare Poixit 3 





Yes ftif'^.i/^o v^o/ fft>Bffl : r-hftPOtrrt — fiLc^dl 




-lee 
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Yes. ^rr\., aAit^ 44f\<ftLf>^U rtiAi-4t^ HiAt'l- 




• Score Foist 4 

■ ft 

w^^^ -tv%^ M^w^ AfA r>n>^> rrifg- 'vtirvta* vV 

u^^^/nr. Uft Av*<A- ^ftif n ^Tgnk— 

MJK^ Y^^%ftiA - Mo -VK^ <Vq _ 
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Age-i? . 



Age 17 
X Sc»re Point 5 



No HAC. /tf >ajutf\: iat jA^ avs 
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Age 17 

Score PoJLnt 5 (Cont. ) \ 



Yea d/iO ^/shlX^ CjJy!^ Hx A r^n^ 



Yes Ai-A 
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'Age: 
Sdare Foiiit 6 



Yes ^ -hhlnh ^e, ^ru cDac) 



■bA^ ^ ^ • ■ ■ ■ ■ * 



• • # # • • • 



Age 17 
Score Point 6 /Cont. ) . 




^ JfiT Ac 0. .A.^^^- .J(V^:irtA ^l» <»Aif- \ JU^ 



4 JtKtfwir: .hf .a. ..^.^ .hiuifi <^~r/^ 
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Content 



Yas 



if T^fi /i^^y^ 




# # • * * ♦ ♦ 







;. 










. . X lULo^'tlt.' ■ 








. -■ ' V:>5:i:^.?iki ' ^- 1''- ■ ■ . 








/ — 
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No 



• • • • • 



Yes 





Age 17 
Itorm (Cont.j 



— 



Age 17 
Subjective Baacticga 



Yes 



■ -'^^yy^P^f^^- — — — 

Yes fl#^c-QuiSg \F a^<NU dr>rvt Ukg^ 4-Ke\L^Qc^ ^OAneo/^g 
Kaqulj y^tsKA. A^cpi^k^ A>yn. i — — 



r^\;gftAtar>e.-e- Vr. — _i , — ^ _L_ — — — 



« « « « • 



No i_Ejfc_^^ 



-a ^ , 
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H-465000-BlB-l,2d 

Read the poem below and then answer the questions on the next two pages. 



OldDog 



Toward the last-in the morning she could not 
get up, even when I rattled her pan. 
I helped her into the yard, but she stumbled 
and fell I knew it was time. 

The last night a mist drifted over the fields. 
In the morning she would not raise her head— 
the far, clear mountains, we had walked 
surged back to mind. 

We looked a slow bargain: our days together 
were the ones we had already had. 
I gave her something the vet had given, 
and patted her stilh a good last friend. 



PLEASE CONTINUE ON THE NEXT PAGE 

V 



H-465000-BlB-l,2d 
(Continued) • " 

D. What emotions and feelings did you have when you read this poem? 
Describe your feelings, in a few words on the line below. 



E. What was it about the poem that made you feel the way you did? Write • 
your answer on the lines below. 



"4: 




bo NOT CONTINUE 
UNTIL TOLD TO DO SO. 
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HAEP Mo;: H-ifc65000-B1B«12 ♦ 

Exercise Type: Parts A,a,C - Multiple Choice 

Parts D,E - Open Ended 

Passage Typd: Literary / Poens 

1979-80 Objective: Part i - Values reading and 

literature 

Parts B,C ^ Conprehends written 
works 

Part D,E - Besponds to written 
, works in interpretive and 
evaluative ways 

1979-80 Subobjective: Part A - Values the benefits of 

reading for the individual 
Parts fi, C * Conpreiiends textual 
relationships 

Part E - Demonstrates aware- 
ness of eoictional impact of 
written works 

BAEP Scoring: Parts A,B/C - Machine Scored 

' = ' Parts. D,E - Hand Scored^ 



Ages 






09 , 


J3_ 


National Results: 


00 
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.27 


.01 




01* 


A 


74.56 


78.22 




02 


A 


15.83 


11 .88 




03 


A 


9.35 


S.89 




01* 
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41 .86 


84 .07 




03* 
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39.63 


82.17 




00 
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9.65 


2,70 




0:1 


D 


33.09 


19.36 




03 


D 


39.00 


.36 .66. 




05* 
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15.66 


4C.54 




07 


D ^ 


.44 


.06 




08 


t 


. 14 


-00 




09 


D 


2.02 


. .68 


I 


01 


EC 


49.68 ■ 


■68.49 




01 


EF 


.07 


1 .31 




01 


ESB 


8.01 


17.65 


■t \ . 


00 


EN 


9.65 


2.70 




01 


EN 


39.00 


Jii) .66 




02 


EN 


13.12 


28.22 




03 


EN 


2.07 


10.17 




04 


EN 


• .46 


1 .67 




05 


EN 


.01 


.31 


* 


06 


EN 




.18 




08 


EN 


35.69 


20.10 



ERIC 



1979-80 

Package Exercise: 

Total Tlae in seconds: 

Source Infornation: 



0507 
027'* 



0504 
0245 



"Old Dog" p. 205 in STORIES THAT 
COULD BE TROE by fillian Stafford. 
Copyright © m1971 by Hillian 
Stafford. Reprinted by permission 
of Harper 8 How, publishers, Inc. 



The range of response percentage vaJ^ues listed for the 
open-ended portion cf this exercise represent both 
acceptable responses, which are marked with an asterxsk 
(♦) , and unacceptable responses (ari others) . • In 
addition, the score points marked with.. the second 
alphabetic codes (C,P,SR or N) refer back to the -second 
and third categorizations on the scoring guider 
C=content, F=fora, SR=sub1ective reaction, and ll=nunber 
cf" pieces of evidence. For convenience, score points 1 
and 2 have bee.i combined into 1, and score points U and 5 
have been combined into 5*. Por exercises without a 
score poin^t I on the scoring guide, the percentage value 
for score point '* on thP documentation page consists of 
responses from store tO., t 2 only. 
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SCORING GUIDE— RESPONDING TO LITERATURE 
EXPLAINING RESPONSES TO LITERATURE 



Emotional Reaponaes 
"Old Dog" 
H-i|65000-BiB--1,2 
Age 9, Package 5, Exercise 7 
Age 13, Package 5, Exercise 4 

General Scoring Rationale ; The responding to literature 
objective was formulated to address "derllberate, 
conscious kinds of Interpretation." It was hoped that 
respondents would not only be aware of their feelings, 
but. be confident about expressing them. Thud, a 
successful response would both Identify an emotion and 
articulate the characters^ events and Ideas from the 
text that contributed to that emotlon% Evidence cart 
also be provided from personal experience, other works 
or special aspects 'of the construction of the text. 

NOTE: Rating should, in general, be done by taking the 
entire student response into consideration without 
regard to what is actually written in the space 
provided for the first part and for the second part of 
the response. If reasons (substantial) are given in 
the first part they are valid. The same is true for 
emotions or feelings identified in the second part. 
Caution should, however, be used, as this often leads 
to nt tendency to rewrite the responses. 
Catego i nations should reflect^., as closely as possible, 
what respondents actually wrote. ; 

Sporing Guiao Categories ; 

I. First Categorization — Identification and 

substantiation oT personal emotions and feelings. 
This takes in^.o accc^unt both open-ended parts. 

Is Unable to ^ identify emotion or feeling . 
Respondents do not dp the task. They refer to 
•the text, but dp not answer even the first 
' question. Examples are: , 

# . A« Some material is quoted from the text with 

no clear Identification of the respondent '-^ 
feeling or emotion. 



B, An emotion expreaaad by a oharaoter ia 
identified rather than the reapondent'a own 
feeling, for example? "The man waa aad." 

C. An obaervatlon about the story ia made: 
• "The title ia mialeading.." 

2 3 Emotion or feeling identified without 

aubatantlation ." Reapondenta name aomethlng but 
cannot go on. They identify emotion(3) and 
feeling(8) but do not aubatantiate oholce(s) 

/ with evideno-e from the text. Reaponsea tend to 
provide; 1) oirctdar evidence such aa: "It's 
sad because it's sad"; 2) a, copy or close 
paraphrase of the text; 3) vague reasons like 

, "The way- it sounds," "The way the author wrote 
it," "The words used," "The way it is made"; or 
4) only a subjective reaction as 
substantiation. 

3 s Emotion or feeling identified and substantiated 

with minimal evidence . Responaents identiry 
emotlon(s) or feelingCs) and substantiate their 
choice(s) with only one reason or piece of 
evidence related to the text. 

A. Reason can be directly related to the text, 
for example: "It .was sad because the dog 
died." • 

B. Reason can be inferred from *the text, for 
example: "Sad because the dog was her only 
friend." ^ 

C. Reason can be inaccurate, if it is related 
to the text. 

D. Reason can be based oa personal experiences 
or opinions'^that are related to the text. 

E. .Reason can refer to (but not retell) 

specific places in the text, such as: 
"Because of what it says in the last 
parsfgraph." , . ' ^ • 

NOTE: "Sorry for the dog" is identification of 
feeling/emotion. "Sorry the dog died" ,is 
identification and minimal substantiation . 
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1 a Jl!!!^lijt£2^^ 

a ub a tan 1 1 a t e d . ' Re a po nd o n i d e n tl f y oWo ti o n ( a ) 
or reeling ra) and aubatantiate their oholo^(a) 
with at Xeaat two reaaona or pieoea of evidence 
related to the text. However, the evidence may 
be preaented In an amblguoua faahlon or be of 
the typea ^deaorlbed In Reaaona muat be 

dlatlnQt<«<«not Inatanoea of the aame reaaona aa 
In *'(Sad) beoauae the dog waa aged and old«'' 

5 = Emotion or feeling Identified and aubatantlated 
In a coherent faahlon , t^eapondenta identify 
emotlon(a) or feellng(a) and aubatantiate their 
oholoe(a) with at least two reasons or pieces 
of evidence clearly - related to the 
text--dlrectly related or can be readily 
Inferred, The reasons are presented logically 
and coherently. 

NOTE: The following types of p?5ipers were 
classified as Indicated and received no further 
scoring; . 

0 = No response . 

7 = Illegible or Illiterate . 

8 s Totally off-task . 

9 = "I don't know." 



Second Categorization — The source of the e/idence. 
Code presence or absence of each of the following: 

1 = Content . The evidence Is based on the content 

of the text', for exarpple: "About the mist over 
the field." 

2 = Form . The evidence Is based on the language, 

style or construction of the text. 

3 = Subjective reactions . These are responses that 

judge the worth of all„or part of the text, 
such as: "I doij't like -dog stories,"* "I hate 
to see a dog dead," "It was Interesting," or 
"It was monotonous."^ Personal opinions about 
the actions of the chal'acters or- personal 
experiences may. be stated, such as: "I had a 
dag that died" or references to the moral of 
the story or general philosophical statements 
are made, such as: "Accept the death oT your 
dog," or "Death Is a mystery;" 



1S7 



Third Categorization — A oounlj of the number of 
"T'ieiaaons or pieces of evidence. Categorization for 
the count of details la aa followa; (1), (2), (3), 
(5), (6), (7 or, more). NOTE: This count only 
applies to papers with primary oategorlzatlon of 
"3" through "5"{ subjective reactions should not be 
counted as reasons or evidence. 
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Aga 9 
Soon I>oinv 2 



A^^mX, Ajfjuii cwTTT^ 





• ■ ■ 



Aga 9 



Jl,^, 4riChj n./9A Culm ■ — I : 

iw.<r f/^,.. 7ht f'.tVAs. : . 






-4^ 



•0 • . 
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Age 9 
^trw Point; 3 (Cont. ) 



7^ --^QfL^Tbl 



/ 

SGor« Point 4 
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MICROCOPY RESOLUTION TEST CHART 

NATIONAL BUREAU OF STANDARDS 
• STANDARD REFERENCE MATEKlAL 1010a 
(ANSI and ISO TEST CHART Wo. 2) 



Age 9 

Score Point 4 (Cont.j 



<;nA /^^ ^k-.p 4Ue,. ^>aL 



yn g itirff ' 






103 

189 
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Ag^ 9 
SoQxe Point 5 



80 A , ym^^iA 



W4 <t>\cji ALsV Nifdf^ \\v^\ mdAe. 



i 
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Age 9 

Saace Point S (Cont. ) 





1 




1 9 - 

191 



Content 






inn 
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Age 9 
Oonbent (Cont.) 







mt-. At^ c^iUrH art' 
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Aga 9 
Subjaotlve Rsaotions 





4^' ^ > 
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Age 9 • 
Subjective Raaotiona (Cont. ) 

7) ^ 

* • I ■ ' • ■ " • _ ♦ 



' ■ \ 

. ' 

o 

. ** o 

,. .... . . « 

a 



Agd 13 
Soooroi Point 2 




# • • 4^ • • • 



\^,T Insl-a-Pncnci. 



Lvfi lonKgel /\ \^fv>rc^\Y^: /Nt^f^r^m ^ ^C|'pikpir 
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Aga 13 

, SoQODB Point ,2 (Gont, ) 
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2QI 
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Ag« 13 ' ^ 
Soort 3 (Cont, J 



-a 
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deo^ JeQ.-fA.r^< tvAtj T f if. I -Hi', A U^. 
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Baarm PoiAt 4 • (Cont. ) 





Age 13 



T^ - Lq. Ar\A ^j- ?y> vi^nj KwppL| 




1W nt.Yvr iwf^is -H^ fimi°> death 





♦ ^ # ♦ ♦ ♦ ♦ 





-2ve 
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Age 13 
Score Point 5 (ContJ 






4- 



2va 



204 



Age 13 
Content 







209 205 



ERIC 



Age 13 ^ 
GGntent (Cent J 



/ml yjnrk ^ nm 4^ -gonri •lin}:r\< 

4^x^ hon nina nhntAdk )Nh^rf 
■U^P. dryq mn-ff. p • r>rrL 





. ' .... . v 

\^\^W. A/ t^^h^ ^^^^ 

:f-y/)r)nty\ ^^^u ^J^y^^ Jj/Jjf;) ^ 
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Age. .13 
Content (Cdnt.) 



7 



T\\g. Loa.L| r\\A 
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Age 13 
Focni 



•V ^ . .♦»*»»»» 



# til ft gn 
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Age 13 
Fooa (ContJ 



^Th^ go#,g^^y J ^iryy jine. poem 




^ c\/^it>.c|^ii^ft, "L-f ^ vor» 





A^e 13 
Subjective Beacticns 



• • • • • • • 



iiiiiiiiiiiii^^ 





/,jS^ TTijm aJa/7f. 
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Age U ^ 
Subjective Reactions (Cant J 



.0 /Ji is^. 





■ « 
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H-467000-BlB-2,3 



Read the poem below and then answer the questions on the next two pages. 



Mother to Son 

Well, son, ni tell you: * 
Life for me ain't been no crystal stair. 
Ifs had tacks in it. 
Q And splinters. 

And boards torn up. 

And places with no cali)et on the floor- 
Bare. ' . ^ 
But all the time 
Fse been a-climbin' on, 
And reachin' landin's, 
And tumin* comers, 
AndMmetimw^^^ 

Where there iain't b(Sen no light 
So bdy,, don't you turn back. 
Don't you set down on the steps. 
'Cause you finds ifs kinder hard. . 
Don't you ^1 now— • 
For I'se still gojn'. honey, 
I'sd still climbin' 

And I^e for me ain't been no crystal stair. ° 



PLEASE CONTINUE ON THE NEXT PAGE 
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H-467000-BlB-2,3 
. (Contin^ued) 



G. Is this a good poem? 



c=> Yes ' 
<^ 7 No 



D. What was it about the poem that led yoii to choose the Answer yoa did in 
.Question C? Write your answer onnhe lines below. 



1 



HAES Mo*-: 
Passage 

1979-80 Obiective: 



1$79-80 isubobjectivei 



N&EP; scoring: 



H-U670bO-B1B-23 ^ 

Parts A,C - Hullflple Choice 

Patii ' D - Op^a Ended ; . /i 

Literary / Po^as ; . 

P^rt i - cbaptehe ndl s nrl tten 

Part C * Values reading ahd^ 
liter at are - . 
Part > Besponds to nrltt^n 
works in intrerpretire aa4J 
evaluative nays 

Part - coiprebenfl^ textual 

relationships ^ 

P4t:t^ c - values the benefits of 

reading for^^^^^t^ 

r rt p - Bya^^ 

rts A,C ilachine Scored 
c D - Hand Scored , 



Nat ional 'BCL^nlt s 



1979-80V 
Packag'e* Exercise: 

Total ^itte ill . Seconds : 
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'87.53 
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V- 68.84 


81.72 
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6.10 


"3.06 


01 D 




6.01 


3.15 


02 D 




35.91 


28.10 


,03 D • 




> 46.i54 


57. A9 


06* D 




4.31 


8.06 


07. \ 




..16 


.13 


08 D 




.05 


' .00 


09 D ■ i 




.82. 


' .01 


01 DC ' 




. -63 .70 - 


76.65 


01 DP 




17.10 


11.56 


01 DSR 

. '. \. 




30.10 


33.31 


— *» 




' . 0907 ; 


0908 



0204 



0189 



Source laforiation: / '^Hother to , Son** fcy Langston 

HughQS. Copyright 1926 by 'Alfred 
k. Knopf, Inc. and reneved 195U 
by Langston Hughes. Reprinted from 
SELECTED POEHS OF^ LAHGSIOH HOGHES / 
by peraission of Alfred A« Knopf, 
Inc. / 

* The range of response codes 'for this exercise has been 
condensed, slightly, so that score pointis '2 and 4 have 
been conblned into 2, and 5 and 6 have been ccnbined into 
6^. 6* is considered acceptable, all other responses are 
unacceptable. In addition, the score points laarked as c^ 
F, or SB refer back to the scoring gnide second 
categorizations of content, fora alSd subjective reaction. 
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SCORING GUIDE—RESPONDING TO LITERATURE 
EVALUATING LITERA.TURE 



Applying Criteria to Evaluate Poems 
"Mother to Son" 
H-4670O0-B1B-2,3 
' Age 13f Package 9, Exercise 7, 
Age 17i Package 9, Exercijse 8* 



General Scoring Rationale ; Since the objective referring to 
the evaluation of written .woi*kS; states that "it is 
important that readers be able to articulate their 
criteria," respondents should explain the reasons or 
criteria fpr their evaluation. To be successful, 
responses should provide exanlple3 from the text that 
relate to those criteria. Plot summary can be viewed 
as minimal support for various criteria; however, the 
best papers should also consider such aspects ^of the 
text . as setting, plot and character development, 
meaning/message, clarity, of lianguage, relevance or 
belie^vability. 

Scoring Guide Categories: 

' * ^ ' 

I. First Categorization — Presentation and elaboration 

or evidence. 7" 

1 s No. criteria or evidence given ; Respondent 

copies part oT €He text or gives a close 
paraphrase or circular response, for example: 
"It was good because it was good," "I -liked 
it," "I didn't like it," or "I »ve heard it 
before." Nonsensical, or wildly inaccurate 
statements are given. 

2 = Gives a yague or ^unelaborated criterion . A 

broad, sweeping generalization or personal 
asser^tion is made which does .not necessarily 
have to restate the phrase "It was good/bad--." 
This response almost could have been given in 
abse^nce of having heard or read the poem. It 
could apply to almost ^any. poem. It 
was-*-exciting , interesting, had a good plot, 
and so on (broad general ad Jectives) . 
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3 s Retells or giv^a aummairy or one vague criterion 
with aynopala aa evlcrence . THe aummary mffy 
refer to part or all of the poem; It may be 
cryptic or leng.thy and well written. Thla 
Includea any citing of content of poem (aa long 
aa It la not baalcally copying). 

M s Glvea two or roore unelaborated criteria . 
'Reaponaea contain two or more generalizations 
or peraonal aaaertlona. (Theae are longer 
•^aa.") 

5 = Glvea one criterion elaborated with evidence . 

Reapondent gives one criterion ^ generalization 
or peraonal aaaertlon that la aupported with 
evidence other than retelling or plot aummary; 
It may or may notu be accompanied by 
: unelaborated criteria. (It waa Intereatlng 
becauae . . .; reapondent gives something other 
than plot summary.) . '' . ' 

6 s Glvea two criteria elaborated with evidence . 
. Respondent gives Fwo or more criteria, 

generalizations or personal assertions at least 
two of which are supported with evidence, other 
than retelling or plot summary; these may or 
may not be accompanied by unelaborated 
criteria. NOTE: Once a paper meets the 
criteria listed for a '^M," "5*^ or "6" It does 
not matter If that response Is also accompanied 
by plot summary. , 

NOTE: The following types* of papers were 
classified as Indicated and received no further 
scoring: 

0 s No response . 

T = Illegible or illiterate . 

8 = Totally off task . 

9 s ** I don't know . ^ 

II. Second/" Categorizatlon« «Basis qf evidence. Code 
presence or absence Yor each of the following: 

1 s Content . The evidence is based on the content. 

of the text i' for ex empire: It was about the 
crystal stair." 
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2 s Form . The evidenoe is baaed on the langi^^gei 

atyle or oonstruotlon of the text, for example: 
. ''There waa ao many mlaapelled worda" or ''Poema 
are auppoaed to rhyme.'' ^ 

3 a Subjeotlve- reaotlona . Theae are reaponaea that 

judge the worth Of all or part of the text, or 
give peraonal oplndona about the actlona of the 
charactera, the bellevabillty of the plot, the 
moral of the poem, or the genre, auch aa: "I 
like poetry." 

NOTE: Second categorization ia only for papera 
with primary categorizations of "2" t^hrough "6." 
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Age 13 
Soon Point 3 
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• mi ftncpjfdMd^^^^ tai mtio 



i 

Ag« 13 
Sc5oni Point 3 (Coni. ) 

No T r-A^ (TTA^^^lt \ % I ^ <nLi irti ■ < „ 

'^ ^^ ^^^^^ ' 
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Soon Point 4 



Ym 



A iJaM, OAfrd V JTYVf A/TV/1fY> . 




No 



YTVL 




Agt 13 * 

Soori Point 4 (Cont, ) ' ^ 



Agv 13 
8eort Point S 



No 



"■^'^ \ y^n\^mm 







ii'-<&£y''''?i3f»l2<fr--i'-^ 
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Age 13 
Qoof Point 5 (Cont, ) 




fir itl-^^U^ 



ERIC 



ZQ3 



225 



Oontint 




CSentint (Gont,) 




Yn 



i Sub jaotlvo macfcl o ni (Cagit. ) 



< Age 17 
Sooce Point 2 




237 

233 
















u.'^c -Hilt 


/9re. jiM*, favt 41ia.Vi ^ 
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Scare Foint 3 r(7<9nt. ; 
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Age 17 
Scoze Point 5 (Coftt. ) 




Age 1' 
Oontent (Cokt.) 



^jjbu tM:^. OAA,, U^t Y Cajic-i flitifL. omJ^ 






Age 17 
Fosn 




Yes 




Yes ^lU^Jf<^Ji^[^i>:^x M^ 



as. 




pr#c^iii^/l. ^v\»i^\-P yt. A:vSft.^m». M>Us. Hike ^rP^vCts^ y 
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Age 17 
Subjective Beactions 




Yes %n i Q i D t. HAtf n/^/VJJr i /v^ VP > Ihr^ O 




J\ge 17 

Subjective Henctiona (Cont, ) 



vu^ . ^>>Q^ r^cvS 
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H-469000«BlB-*3 

Read the poem below. Then write an essay about an important idea or theme 
of the poem. In your essay tell how such things as the images, events, sound 
and structure contribute to this idea or theme. We are interested in what you 
have to say, not your spelling and punctuation. Write your essay on the lines 
provided on the next two pages. You will have 9 minutes to read the poem and 
write your response. 

i was you 



i smiled 
your smile 
till my mouth 
was set 
and my face 
was tight 

and it wasn't right 
it was wrong 
i was you baby 
i was you too long 

i said 

your words 
till my throat 
closed up 
and i had 
no voice 
and i had 
no choice 

but to do your song 
i was you. baby 
i was 3 ou too long 

i lived 
yoMT life 
' till there was 
no me 
i was flesh 
i was hair 
but i wasn't there \ 
it was wrong \ 
i was you baby \ 
i was you too long 
and baby baby 
the T^orst thing 
to it 

is that 70U let me 
do it 

so who was weak 
and who was stro^/ig 
ibr fc>o long baby , 



PLEASE CONTINUE ON THE NEXT PACE 
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H"469000-BlB-3 

(Continued) 



IF YOU NEED MORE SPACE, CONTINUE ON THE NEXT PAGE. 



2Z2 
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H-469000-B1B-3 
(Continued) 




^JQP I DO NOT CONTINUE 



UNTIL TOLD TO DO SO. 
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3979r80 Obiectiv©: 

1979-80 Suboblective: 
HASP Scoring: 
Ages ^ 
National Beaults: 



1979-80 
Package Exercise; 

Total Time in Seconds: 

Source fnforiiationt 



H-a69000-B1B-3 ♦ 
oped Bndad 
Lltecacy / Poeaa 
Respondjii to writtian v^tks in 

interpra^ iive and agalu'atlyq waya 



Analyzes written vorks 
Band Scoied 




00 
01 
02 
04 



A 
A 
A 
A 



06* A 



07 
06 
09 



A 

A 
A 



-12- 

3.94 
12.44 
57.85 
18.96 
4.65 
.83 
.57 
.75 



0508 
0570 



"i was you" from CK HY \HAY TO 

HEEBE by Cori Previn putlisKed by 

Saturday^^^^^^ 

by peraission of the publisher. 

The range of response codes for this exercise has \ heen 
condensed slightly, so that score points 2 and 31 have 
teen combined into 2, and 5 and 6 have been ccmbinediiinto 
e'i'. 6* is considered acceptable, all other responses | are 
unacceptable. i 



SCORING GUIDE— RESPONDING TO LITERATURE 
• ANALYZING LITERATURE- 



"i was you" 
H-il69000«-B1B-3 
Ag9 17i Paokage 5, Exeroiae 8 

Gen era! So o r t ng R a 6To n a 1 e ; The' objeotivea atalbe that 
atudenta ahould be able to turn to a text and attend to 
special aspeots, s.uoh as the stylistic conventions 
employed, the forraai, structure or areas of multiple 
meaning. A successful analysis goes beyond 
interpretation, providing a theme or meaning, and 
discusses in what way particular features-^images, 
sounds, events and structure--*of the poem contribute to 
the theme. 

Scoring Guide Categories : 

1 = Nb aVialyais . These responses only evaluate the poem 

or ^ts features or make empty or glancing references 
.to various features. Examples are: "All and all 
this poem was pretty an5i I enjoyed it," "It did have 
a lot of phrases that rhymed," "The poem presented 
poor images and' events," "The structure was catchy," 
or "The sound ts your singing a song." 

Some catTegory "t" responses do include brief 
allusions to the poem. However , these mentions of 
text are not considered synopsis. Also, wildly 
<> inaccurate interpretations of the poem and 
nonsensical responses should be placed in this 
category. 

2 = Synopsis . These responses mainly retell or summarize 

the poem. Although* some may include evaluations and 
empty or glancing references to other features, 
sometimes a brief synopsis can be embed (fed. in an 
evaluation. If so, place it in category V2.\ The 
same is* true of some r e f er ences to • im ag e s . When the 

; meaning o f an image is n 6t given j but pa rt o f the 
poem is repeated, then jbhe response can be placed in 
c ategory "2 . " . Al so , response s that i nclude glancing 
references to a aumber of features including events 
should be placed -in this category. In summary j" a "2" 
re s'po n se at 1 e a s t rete 1 1 s y s ummar i zes , o r ■ re fer s to 
particular parts of the poem. However, Ijt does 

^little else of substance in terms of analyzing the 
poem. ' 

: ■ « : ■ 255 : , 



Theme . These responaes state an Idea or theme of the 
poem, but do little of substanoe. They do not 
include synopsis or relevant disouasions of other 
features. Some may include evaluations, glancing 
references to features, or "phi-losophizing" about 
their theme that is not particularly relevant to the 
poem. In other words, some "3" responses may gQ„,off 
on tangents (initiated by the theme) which are not 
text based. A paper with no theme statement, but a 
substantive! statement of one feature other than 
events should also be placed in this category. For 
example; "An image is given." Some themes are: "It 
presented the idea of weakness in people,^' "The basic 
idea of tha poem is how love hurts when misused or 
mishandled," "The theme is that you should not try to 
be somebody else," or "Always be your, own person." 

With a poem'in particular, the difference between' 
"synopsis" and "theme" is often a fine distinction. 
Yet the basic difference is whejbher or pot the 
idea/message is stated as a generalization. Synopsis 
can involve hypotheses about meaning yet this is 
usually interpretation pot generalization, for 
example: "I thinK it means he/she lost his/her 
identity." Also, some "3" responses elaborate their 
generalization to the point of directly referring to 
pans of the poem, such as: "By living by someone 
else's feelings, views, likes, and dislikes, talks 
and walks, you do not have an identity of your own." 
However, these should , still • be placed in category 

"3." 

Minimal evidence of ^analysis . Some ^^f these 
responses state - an Idea or theme of the poem and 
relate events in the poem (plot summaries may be 
quite thin). References to specific R^rts of the 
text qualify as synopsis. Other responses placed in 
this category discuss at least two features, one can 
be events (synopsis), Tn i substantive m-anner — ► 
however, there is no statement of theme. 

Evidence of analysis . These responses state an idea 
or theme or EHe poem and include a substantive 
statement about aijb J east one feature other tfhan 
events (synbpsisT; For example, the structure might 
be discussed, such as: "The short lines and the 
choice of words suggest that this person is still not^ 
himself" or »*The structure^ of -this poem brought a 
melody of music, as though it wer^ the lyrics of a 
soft-spoken song of tearful anger." These responses 
may also include synopsis or any of the other 
characteristics of papers placed in c>b^ories "1-4," 
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However, the major drawback with category "5" papers 
la that they may be brief ( Include only one 
substantive statement), or, If they do Include 
discussions of several features, the features 
explained or even elaborate,d do not all relate or 
refer back to the Idea/theme proposed In the 
response. The relationship between the stated theme 
or Idea of the poem and the discussion of the 
features Is not explicit or even readily Implicit, 

6 a Integrated analysis . These responses state an 
Idea/theme and discuqs at least two features, one can 
be events (synopsis). In a substantive manner. Th^y 
often have the' components of "5" papers, yet the 
discussion of the features does relate to the 
proposed Idea/ theme. These are coherent , organized 
responses. 

NOTE: The following types of papers were classified as 
Indicated and'reoelved no further scoring: 

0 = No response . 

^ 7 ' = Illegible or Illiterate , 

8 s Totally off task . 

9 = "I don't know."" 
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kg* 17 ' 
SoiMrti folnt I (Cont,) 
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Age 17 
Soppe Point 2 




s4 hi>. 
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. Age 17 
Sooce Point 2 (Cont:) 




i^AT^ ,jS?(gam \t^im ^fiirtV 
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Age 17 
Score Point 3 




'9 



P IT -rr^ 11^,;^^^^ oH/d rlfKT^/jr ^n^o. 
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-\ - Score Poi^^ CCont* ) 
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Score Point 3 (Cent J 
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Score Point 4 (Cent. J 




♦ » • • •.» • a 



— "TVo. (jr*g^ L.k jdri^^jt ^^«4r Vj^^^.f. Xg^-^Q 
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Age 17 ~- - 
Sooare^foint 4 (Cont.) 
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Soore Point A (Cont.) 




Age 17 

Sooare Point 5 • . 
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Score Point 5 CCont. ) 



Jd2 



— ^AiU^'i^ O:^ dZZ^ 



<^r>flv>g?E^,^#-^. 
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■ Score Voixxt 5' (Cant ^ ) 
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Age 17 
\ Soora Point 6 (Cont.J 




< 0 
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Age 17 
Score Point 6 (Cont.) 



7A> .^..^^^^1 ^ *^-«rdr "^'^ '■^^"^ >»Tt^f.J 
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Age 17 
Scjore Point 6 (Cant.) 



M 4Aqf: Ql^ ^a/^ ^IKWuU irA-kj^-to h n.mhtifrry 
OaI^ CflfetS rvyt^ ^AQJ^ li)^ Q7UU 
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H-a4l000-BlB-l,2,3 

What makes a good story? List three things on the lines below. 

Age 9 9.5 - 14.3 2.6 13.8 2.6 1.0 36.1 6.3 13.8 

Age 13 2.1 0.0 20.4 3.7 20.7 13.3 0.2 30.9 , 5.6 3.0 

Age 17 2.2 - 21.9 3.1 25.5 19.5 0.0 25.4 1.6 0.8 



Age 9 29.3 - 11.1 2.8 U.3 1.4 0.6 25.5 6.4 U.6 

Age 13 7.3 0.0 20.5 5.3 21.6 10.3 0.2 27.0 5.2 2.5 

Age 17 '5.3 . - 23.5 5.5 20.8 14.5 - 27.3 1.6 1.6 

Age 9 50.8' - 7.4 2.2 6.3 0.6 . 0.4 19.3 3.7 9.4 

Age 13 20.3 0.0 16.3 7.2 15.4 5.7 0.1 27.8, 3.8 3.4 

Age 17- 14.9 - 19.7 9.0 17.0 7.2 - 29.3 1.4 1.4 





00 


01 02 


! 03 


04 


05 . 


06 07 


08 








' ■ 


Levels 












Aqe 9 


9.5 


31 ..4 


1.5 


0.4 


57.2 




> 


Age 13 


2.1 


52.4" 


2.0 


3.8 


39.8 






Age 17 


2.2 


66.1 


1.4 


2.4 


27.8 






Age 9 


29.3 


25.0 


1.2 


0.4 


44.1 




2 


Afje i";J 


7.3 


50.4 


3.5 
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35.0 






Age 17 


5.3 


57.9 


3.5 


2.8 


30.5 






Age 9 


50.8 


14.9 


1.2 


0.3 


32.8 




3 


Age 13 


20.3 


3'>2 


4.7 


2.7 


35.1 






Ag^i .7 


14-9 




5.7 


2.7 


32.1 








00 


OX 


02 


03 


08 




DO NOT CONTINUE 
UNTIL TOLD i:0 DO SO. 
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NA£P Mo. : 
Exercise Type: 
1979-80 Objective: 

1979-80 Subobiective : 

NAEF Scoring: 

Ages 



Ir i :^)0-B1B-123 
Open Ended 

Responds to written works In*^ 
interpretive and evaluative ways 

Evaluates written works 

Hand Scored 

09 13 17 



1979-80 

Package Exercise: 

Total Tine in Seconds: 



1104 

bdeu 



1405 
0066 



1005 
006U 
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SCORING GUIDE--RESPONDING TO LITERATURE 
EVALUATING LITERATURE 



Qualities of Good Literature 
"Good Story" 
H-841000-.B1B-1 ,2,3 
Age 9, Package ]1, Exercise 4 
Age 13i package 14, Exercise 5 
Age- 17 1 Package 10, Exercise 5 



Scoring Guide Categories ; 

First Categorization — Description of type of 
qualities listed • 

0 = N o response , 

1 = Relationship between form and content . 
Respondents rffay state that the dialogue is 
compatible with the topic, for example. 

2 = Content . Respondents may refer to ohe„ or more 
of .the' . folloy^lng types of content: mystery, 
westerns, fantasy , adv^enture danger, « action, 
humor, suspense, roro^ince, <S. ama, any reference 
to theme, or excltemei t 

3 a Form . Respondents me'^itlofi soTne aspect of form, 
such as: high pcl^'. strong words, vivid 
lanf:^ jipre, suspenseful beginning, length, style, 
conav: u M'iion of the text, or happy ending. 

4 s 3ub"fisC ( Ue Tfe^Dtlo n. Respondents give a 
strttf^STtsnt to che effect that a good story 
shoild ^'voke e subjective reaction of one of 
the following types: sensible, interesting , 
intelligent, funny, imaginative, dramatic, 
suspenseful, or adventurous. <^ 

5 s Unelabor at ed features of genre . Respondents 
refer to one of the following characteristics: 
plot, chara^iter , setting — with or without 
redundant "good." 

6 = Naming of a speciglc story or author . 
Respon(?ents list a particular title or author. 
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7 = Undetermined or oiroular t These are responses 
where y;ou cannot determine, whether the quality 
is one oT^oontent or form,* or the answer is 
oircular/ for example: the writer, author, 
good author, good literature, good writing , 
good wofds, the title, the ending, language, or 
good subject. 

8' = Referenoea to format . Respondents list some 
quality related to format, for example: 
neatness, commas, quotation, indentations, 
capital letters, summary, controlling idea, or 
hds a title. 

9 = Other . Responses are totally off task, 
illegible, illiterate, "I don't know," or 'other 
nonsense. 

. Second Categori2ation «"*Level of ^the qualities 
listed . [ ^ s . 

1 = Identifies characteristics of work as a whole . 

Responses refer Eo sex , violence , human 
adventure, catchy title, dialogue , plot , or 
setting/ 

2 = Analyzes the way the text works . Respondent 

states ideas, such as: use of foreshadowing or 
irony, ^ sentences are to the point, the tension 
rises, enthusiastic words are used, surprise 
ending is effective. ' 

3 = Makes statem ^jnt s about the meaning or theme . 

Respondent ' t ■ akei statements, such aai "It 
makes me thxnk";* "It has a good moral"; "Jt 
expresses yo- feelings"; or "It has meaning, 
^ ^^meaningfulness." 

NOTE: This categoriziation only applies to papers 
rated "1" through "5" for the first categorization. 
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Age 9 
Scx»re Point 2 



rJL ^ ftT^^^ ^J^JL^ ^TL^Xa^ 



'.4. 4.ri.^. 
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Age 9 
Score Point 3 
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Age 9 
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Saovn ^Int 6 
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^ Ago 
Sooro Ptyint 7 



4 




* ■ \ 
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Soors PQint 8 
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MICROCOPY RESOLUTION TEST CHART 
NATIONAL BUREAU OF STANDARDS 
STANDARD REFERENCE MATERIAL 1010a 
(ANSI and ISO TEST CHART No. 2) 



Score Point 9 
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Age 9 

Identifies Characteristics of Work as a Whole 
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Age 9 

Analyzes the Way the Text Works 



Age 9 

Makes Statements Abcxit the Meaning, or llieone 
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Age 13 
Score Point 2- 
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Age 13 
Scort Pdint 5 
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Age 13 

AnalyzM th« Way the Text Morke 
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Age 13 

Makas Statanants About the Meanifig or Theme 
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Age 17. 
Socare point 2 
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Age 17 
Sooro Point 3 
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Socora Foin^ 4 
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Age 17 
Sooee Point 5 
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"Age 17 
Score Point 7 
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Sorare Point 8 
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ScQEce Point 9 
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Identifies Chacacteristlcs of ttork as a Whole 
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Age 17 

JmaXyzea Mm Tesct V*5rks 
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Age 17 

Makes Statemexits About the Meaning or Hvaas 
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^ What makes a good poem? List three things oft the lines below. 

"Ages U.e 0.0 8.6 34.9. 6.2 0.2 0.8 21.1 3.7 12.5 

Age 13 5.6 0.0 8.4 48.2 d.2 0.6 0.3 20.6 3.2 4.8 

17 3.3 0.0 U.l 38.1 16.5 1.0 - 27.4 0.8 1.7 



Agi^>9 32.0 
Age 13 13.5 
^ Age 17 7.8 



7.7 13.2 9.7 0.2 0.5' 20.'6 $.0 10.2 
0.0 10.3. 21.9 15.0 0.8 0.3 "26.1 6.4 5.7 
0.1 12.6 '27.5 1^.0 0''.7 - 29.2 1.2 1.8 



3. 



Age 9 51.8 
Age J.3 30.6 
Age 17 19. d 



- 5.5 6.3 6.3 0.1 0.3 16.4 5.0 8.4 
0.0 8.8 13.5 12.8 0.5 0.2 19.8 7.2 6.7 
0.0 12.5 16.1 20.6 0.8 27.2 1;2 1.8 
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Levels 




i 






Age 9 


. 11.9 


48.2 


1.2 


0.6 


38.1 


Level 1 


Age . 


5.6 


60.9 




-i.i , ' 


28.9 




'.Age 


, 3.3. 


54.3" ' 


'3.7 


8.7 


30.0 




Age 9 


32.0 


29.0 


1.4^ 


0.4 


37.2 


Level 2 


Age 13 


13.5 


42.0 


3.1 




38.5 




Age 17 


7.8 


' 45. 7i- 


4.7 " 


9.6 


32:2 




Age 9 


51.8 


- 16.5 


a.i 


0.6 


30.1 


Level 3 

» 


13 


30.6 


30.5 


2.2, 


3.0 . 


33.8 




Age 17 

iT ' ■ 


19^8 


38.6 


2.6 


8.9 


30.2 
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CTr%» I DO NOT .CONTINUE • 
a I V/ri UNTIL TO^D TO DO SO. 



310 , 



314 . ' 



ERIC 



VA^P HO. : ' . 

Exercise Type: 
1979-80 Qbjective: 

1979-80 Subobjective; 

N&EP Scoring: 

Aaes 



H-8U2000-B1B-123 
Open Ended 

Responds to vritten votks In 
interpretive and evaliiative vays 

Evaluates vritten vorks 

Hand Scored 

09 _ 1.5 . .17^ 



1979-?80 

Package Exercise: 

Total Tise in Seconds: 



1008 
0065 



08'10 
0066 



0808 
0065 



SCORING GUIDE— RESPONDING TO LITERATURE 
EVALUATING LITERATURE 



Qualities of Good Literature 
"Good Poem" 
H-842000-B1B-1 ,2,3 
Age '9, Package 10, Exercise 8 
Age 13, Package 8, Exercise 10. 
Age 17, Package 8,' Exercise 8 



.Scoring Guide Categories ; . ^ 

I. Fir^st Categorization — Description of type of 
qualities listed. I 

0 a No response . 

1 s Relationship between form and content . 

Respondents miy state the . rhyme pattern is 
compatible with the topic, for example. 

2 = Content , Respondents may refer to one or more 

of the following types of content: mystery, 
westerns, fantasy, adventure, danger, action, 
humor, suspense, romance, drama, any reference 
to theme, 'or excitement. 

3 s.Form. Respondents mention some aspect of form, 

such as: good rhyme, high point," strong words, 
vivid language, suspenseful beginning, length, 
- style,, construction of the text, or happy 
ending. ^ 

n = Subjective reaction .. Respondents give a 
statement to tEe 'effect that a poem should 
evoke a subjective reaction of one of the 
following . types: sensible, interesting, 
intelligent, funny, imaginative, - dramatic, 
suspenseful, or adventurous. 

5 = Unelabor»ted features- of genre . Respondents 

refer to one of the following characteristics: 
plot, character , setting—with or without 
redundant "good." 

* • ■ ■ ■ . tj ■ ■ ' .' . . . ■ . 

6 = Naming of a specific poem or poet . Respondents 
- list a particular poem or poet. 



316 



312 



( 7s Undetermined or olrcular > /These are responses 
where, you oannot determine whether the. quality 
Is one of content or formp or the answer Is 
circular, for example: poet, good poet, good 
, literature, good writing , good words, the 
title, the ending, language, or good subject. 

8 s References -to format . - Respondents list some 

" quality • related to format, for example: 
neatness, commas, quotation, indentations, 

_ capital letters, summary, controlling idea, or 
has a title. 

1 , ■ ■■ ... 

9 s Other. Responses are totally off task, 

illegible, illiterate, "I don't know," or other* 
nonsense. 

II- Second Categorization^ ^Level of the qualities 
listed. ' ~ 

1 s Identifies characteristics of work as a whole . 
Responses refer Eo sex , violence, human 
adventure, catchy title, dialogue, good rhythm, 
plot, or setting. 

2. s Analyzes the way the text works . Respondent 
states ideas, such as: use of foreshadowing or 
irony, the tension rises, enthusiastic words 
are used, or surprise ending is effective. 

3 = Makes statements about the meaning or theme . 
Respondent makes statements, " such asl 'Tt 
makes me think**; **It has a good moral**; **It 
expresses your feelings**; or **It has meaning, 
meaning fulness.** 

» ... 
NOTE: This categorization only applies to papers 
rated **1** through **5** for the first categorization. 
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9 ^ 
Sdore Point 2 



314 



318 



Agre 9 
Score Point 4 
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Age 9 
Score Point 5 
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Soora Point 6 
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Score B9lnt 3 - 
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Ags 13 
Score Point 4 
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Age 13 
Score Point 5 
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Sooirs Point 6 
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Score Point 7 
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lathtifiM Characteristics of f^rk' as a Miole 
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Age 17 
Score Boint 4 



ITV' %^ottlc/ t^dJCtL S«^ftr 
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Age 17 
Score Point 5 
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3^4 
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Age 17 
Score Point 7 



3^5 
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Age 17 
Score Point 8 



3<J6 
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Age 17 
Soora Point 9 



1ou rnMSt la* aU^c 



L^W :V7.<.(^ 4>W 
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Age 17 

IdaitiLfies Characterlstlca of Work a& a Whole 




Aga 17* 

Ahalyaea tha Hay the Text Works 
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Age 17 



Makaa statoipita About tha Maaning or itiane \ 



\ 



4-20000S«22a-2 

You are going to bo asked to write a oompoiition about a poem. 1 will 
read the poem to yoi! ai you read it to yourself. When we have read the 
poem carefully, write a composition In which you discuss the poem. We 
are more intoreiteci in what you have tp jay than in how well you say it 
Put the title of the poem at the top of the next page. ^ 



Check 

Vxt Night creeping on the ground! 

She crept and did npynakOLajounSt^ — — ' 

Until she reached the tree: And then ^ 
She covered it, and stole again 

Along the g^ss beside the wall! 
* • I heard tl{e rustling of her shawl 

As she threw blacicness every where 
Along the sky, the ground/ the air, 

And in the room where I was hid!£ ' 
But, no matter what she did- 

To everything that was without ^ 
She could not put my candle out! 

So I st^d at the Night: And she 
Stared back solemnly at me! 

James Stephens 



PLEASE CONTINUE ON THE NEXT PAGE 
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(Continued) 
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4«200009-22B"3 
(Continuecl) 




^YQP i DO NOT CONTINUE 
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NAI9 NO, I 

Bx teals* 7ypti 

1979-80 Sttbobj«otlv«i 

1970-71 ObjtctiwtJ ' 

1970-71 
HASP Scoring: 

National Reflultai 



Uf20000S-22B*2 ^ 

fitaponda to wcitt«n vocKa In 
intcEpcatlvf and •vAluativa waya 

Appllaa pa^aonal •xpfslanea oc 
Kdofladga of othac Mocka oc flalda 
oij atudy to wcittan voska 

Beooaaa Bngagad in, Vlnda Naanlnga 
in|, and BValuataa a Heck ot 
Litacatuca 

Sappondlng to Lltacatuce 
Hand Scoc«d 



90.17 
2.95 
3.86 
.83 
1.a8 

56. 7j 

5.34 

. m 

21.09 
6.87 
6.30 
((.85 

11.76 

69.47, 
.04 
1.13 

21.49 
2.57 

35.07 
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Package Exercise:: 
1970-71 

: Package Exorcisfe: 



1008 
0917 



Total tine in Second s ; 



0644 



soucq« Xn<QSMtiont **ChteR" by Jancf sttphinst U8«d' 

PuoliiAlitg cotf InOff CVob 
COLIICTID fOB,|]8 Of QtkMMti Stspbtnti 
Copyciaht . 1919 by Haoilllan 
Pul^liaoing co.f Im%, stntwad 1943 
by aaidA sttpbtnat 

* xbf canqa of ctaponat ao4«a foe this fxovolfo li quits 
bcoad, arA thf lattir oodaa on thia paga tand to cafac 
baoK to tha ooccaaponding 'ioodaa ^ on tba aoocing guida. 
Exoaptlona aca tha "Rn ooda* vhloh capsaaanta tha total 
paroantaga of raaponaaa judgad to ba catablaf and tha 
valuaa aaaooiat^ad with tha »9» coda, whioh Ifdloata tha 
fsaquanoy with whioh aaoh of tha nu'aatoaa caaponaa 
ciatagociaa waa aalaotad aa baing pcadoninant. 
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SCORINO QUIDE-^PONDINQ TO LITERATURE 
Q'«n«ral Rtspondlng 
Agt 13» PflQkag^ 10, Ex«rols« 8 
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Oanaral fSoorlng Ratlonalu Thora are aavaral major ways bo 

^ ({oilier ""iindaKsliand f Wg of a wrUton work., Raapondentja 

oanVusi <• awarantaa* of amttional impaot, parponal 
axpartanoa and knowXadga of othtr worka to intfcrprat. 
provide .meaning, evaluate and analyie the^ , * 

content analysis of the reaponaea not only provldea 
Information about which Internal resources reapondenta 
tend to draw upon to help their understanding of 
written worka, but also the cognitive skills they 
choose to demonstrate when given an opportunity to 
respond. freely. It is expected that the results may be 
highly text dependent. Also, the bet.ter responses 
should move beyond plot ■> summary and retelling to 
provide meaning, evaluation and particularly analysis. 

Scoring Oulda Categories } 

Descriptive information: Code each type as- present or 
absent. Code one type as predominant. > , 

EG a Egooentrio .. . Reaponaea are not text baaed, but 
^ are text relevant. | Respondent writes a letter or 
poem 'Of his own or writes another, poem (or 
excerpts) 'that h^ has memorized.' Other types 
of statements categorized here are; "I never 
Vead poetry," "I'm not good with poems," or "A 
^oheok on a piece of paper because he got the 
answer wrong." 

PR a Personal. Respondent identifies with characters, 
make Judgments about actions of characters or 
give adviqiB, "for example: '*I feel that the poet^ 
is right." Also, statements are made such as: 
"I like p'oems about nature," "I wish I could 
write a poera,ai4w t,hat," or "This is not my kind, 
of poem." \ / 



■„,: 3-56 

■ 352; :'■ 
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EM s Emotional > Respondent attr Ibutes emotions to the 
text or makes a direct statement of emotion, for 
exatnple: ^The poem was sad," "It's touching, 
"It had a funny feeling," "It was very dramatic ," 
"It was a spooky poem," or "It was a mysterious 
poem." 

* Rtt^lllng * Respondent summarlaeeis or paraphrases 
the poem (or parts of It) using specific words 
from the poem. Reapondtnt gives a synopsis, 
overview or brief desoription of the po^m or 
part(s) of It. (Disregard inaccuracies.) 

IN s Inferencing . Respondent goes beyond the text and 
provides motivations for characters. 

GN a G en eraliza tip n .^^^^^ Resj^ti^ attributes meanings 
to the po em i such \a s : "You shouldn' t close your 
mind to anything unknown," or "It means that the 
world is suddenly a check of darkness •" 

^ Analysis > Respondi^nt discusses the language or 
$tr(ieture of the poem, for example: "The poem 
doesn't rhyme," "The poem seems more like a 
story," "The night si^dnied Ijke a witch," "It 
could have more detall^s and not so many long 
words^" "The author milkes the night sound like a 
real person you could reach out and touch," "I 
didn't see any misspelled words," or "It wasn' t 
long enough." 

OW s Other works. Respondent classifies the work as 
to genre or type. Respondent compares the poem 
to other works or art forms, such as: "It's not 
like a poem I've seen before,'' "I think it's a 
good soap opera," or "It was like a mystery." 

EV « Evaluation. Respondent judges the worth of the 
wock, for example: "It was stupid," "I don' t 
like It," "I didn't understand it," "It doesn't 
make sense," "It Is nicely written ," "It was not 
exciting or sad . " or "It has no meaning ." 

NOTE: In addition tt • le papers which were considered 
rateable (1 s rateable: and which were analyzed using 
the categories described above, some papers were not 
considered rateable and these were placed In one of 
the following classifications: 



0 s No response . / 
2 5 Nonrateable . Copies or circular. 

7 = Illegible, illiterate . 

8 s Totally off task . 

9 s "I don't know." 
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Age 13 
Score Point EG (Cont. ) 
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Sooxe Point {"S (Personal) 
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Sooxe Point PR (Cont. I 
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Score Point PR (Cant.) 
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Soare Poiht EM (Coni.) '/'"K; 

ba ..t i. sr5vi ffln^^lfjrftr sainHmiia ^ftiiahtv. 

Jl£a|a iD£ flLTPuneJp 4Kn>tt3mj Hot^cnPgc & ^e^ii)hpO^ 
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Age 13 
Sooie Point KT (Cont.) 
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Sco.tiQ Point ^ (Generali zation) 
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Age 13 
Score Point QI (Cont.) 
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Age 13 
Score Point Qi'(Cont.) 




Age 13 
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Scxxce Bolnt QU fCont.) 
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Score Point AN (Analysis) 
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Age 13 
Sasre Point AN (Cont,) 
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Age 13 
aaoxn Point AN (ContJ 
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Sopim Point BV (SvAluAtion) 
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MICROCOPY RESOLUTION TEST CHART 
NATIONAL BUREAU OF STANDARDS 
STANDARD REFERENCE MATERIAL 1010b 
(ANSI and ISO TEST CHART No. 2) 
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Saare Point EV (Cont.) . 
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AgiB 13 
Sc3Drv.'j Point EV (ContJ 
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4-200008-22B-3 

Write a composition in-which you discuss this poem. We are more interested 
in what you have to say than in how you say it. 



Into my heart an air that kills 
Prom yon far country blows: 
What are those blue remembered hills, 
Whet spires, what farms are those? 

That is the land of lost content, 
I see it shininff plain> , 
The happy highways where I went 
And cannot come again. 

A .E. Housman, 1890 
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PLEASE COKHNUE ON THE NEXT^AGE 
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IF YOU NEED MORE SPACE, CONTINUE ON THE N1|XT PAGE. 
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(Continuecl) 
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^rfSD I DO NOT CONTINUE 
^■ Wr I UNTIL TOLD TO DO SO. 
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NAEP No. t 
Exocclfltt Typ«; 
1979-80 Obi«ctive: 



* 

197 9- el) 



Subobjectlve: 



1970-71 Objective: 

m 

1970-71 Theme: 
NAEP Scoring; 
Ages 

National Results: 



4«;)00008*22B«3 * « 

Open Budea • " ' ' 

Reaponda to written wocks In 
lntecpretlv«. and eveiluatlve daya 

- Applies peca'dnal expeilence oc 
^ a knowledge of other wprka or fields 
of atudy to written worHa 

Beconea Engaged in, Finda Neaninga 
in, and ^valuTatea a Work of 
Literature ° . 

Besponding to Literature . 

Hand scored . 
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-IT," 

89.38 
7.72 
3.57 
1.19 
.23 

71.111 
1.75 
' .*38 
.11 
7.55 
.25 
.26 
2.87 
5.65 
15 
4.07 
17.59 
76.16 
4.35 
4.83 
.40 
15.35 
1.00 
.95 



ft 



1979-80 " . . 

,197c2f71 " V 
PoQkftqe Exflcolfldi 

Total Tint ln,.Stconda) 

Sou'coe inf^cnatipnt 



1010 
0217 

H ' ' • 0H33 

" sltcorpt icoQ "A shrcpihit« Lad" , 
-Authoiiflfd Edition* fcon THE/ 
K ' COLLSCTSO POENS OF A. E.. HOUSHAIT*" 

X Copyjcight 1939, »19t>0 , ® 1965 by 

s Holt, Blnehaxrt and Minston. 

' Copyright © 1967, 1968 by Robert 
, ' E. Synons. Beprlnted fcy pernlasion 

of Holt, B^-nehaift An^- Hinaton, 
• \ Publishers. 

The - ranqe of response cod.es for thi's exercise is guite . 
broad, and the letter codes on this page tend to refer 
back At o the corresponding codes on the scoHng guide. 
Exceptions are the ••R" code, which represents ' thb total 
percentage of. responses judged to be ratable, and the 
values associated vith the '"P" code, which indicat4.< the 
freciuehcy with which ' each of the nunterous response 
"categories: was selected as bedn'g predominant. 
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mm- 



SCORING QUIDE»RESPONDZI^Q TO LITERATURE 



A8« 



"Into My HSiirt" 
17i Pookagt 10, E««rols9 



10 



Qentral Scoring Ri^tjLonaVi > Th.ara ara aavaral major waya to 
; daepan undaratanding of a writtian work,, Raapondanta 
Qtn uaa awaranaaa of arqotlonal impaot^i • paraonal 
. axparianoa and knowladga of o^thar v/orka to Intarprat, 
proV'ida maanlng, ayaluata and fnalyza tha taxt, A 
Qontant analyala of tha raaponaaflf npt only providaa 
Information about whloh Intarnax raaouroaa raapondanta^ 
tand to draw^ upon to halp* thalr undaratanding of 
rwrl^tain worka, but also tha tfognltlva ^ skijlla thay 
ohooaa to damonstrata whan glv^n an 'opportunity to 
raspond fraaly, . It la tixpaotad that tha' rasulta may ba 
highly taxt dapandent ^ Alao » tha battar raaponaea 
ahould move 'beyond ^ i^ot nummary and ..retelling to 
provide meaning , evaluation and particularly analyala*. 



Sobrfng 6uide Categories; 



Descriptive informat'ibn:' Code each tyi^ 
absent. Code one type^ as predominant, 

Eff s Egocentric . Responses-are not text *based, but 
• are text relevant^ Respondent writes a letter 'or 
poem of his -own ^ or wrltTes another poem (or 
excerpts) that he ^has memorized; '0};h§r' types 
of statements, categorized here are: "I, never 
read /poetry," "I'm .not good with poems," or "I 
love * the , beaph—tt 'helps me put my mind off 
things\" 



aa present or 



personal 
sense — 
ments .ajbout 
giving , 



PR a Personal»^«>arraXytic . Respondent ^g^ives 
' reactions Co" content ' in an ''" analytic 
identification with characters, J i 
actions ,of characteF^a "and advice 
obs'f rvatidrrs about the. Way . society shoultl/ddes 
work. Respondent states, for example: "1 raigbt 
have felt the saine thing "It descr-ibes my 
reelings pf moving to a n.ew state," or^^I-feel 

/ that the poem is right by talking about the real 
' prolyl ems .of air ppll^^ facing us . " • 
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ITOflltrtirTiWrt and eenfet^fc in a globa l aanaa. 
ExampUa would bt atafcaniania of IFe foUowlni 
typti 1*1 Uka poama about natura." "I oan rtlals 
to thia poam,'* "X wlah X oould writt poama Uka 
thia,'* or "Thia U not my kind of poam." 



" BmoUonay . Raapbndant attributaa amotlona or 
'TaaTTnga of mood to tha tax,t or, makaa a dirts fe 

. atatamant of amotion. EKampiaa would inoludai 

VHTha poam waa aad." "Xt,*a touoning," "Xt had a 
funny* faaling," *'Xt waa vary dramatio,** "It gava 

' a happy point of viaw," or "Tha anding makaa you 
faal aorry for him," 

RT I RataUlng. Raapondant aummarizaa or rataiia tha 
poam or part(a) of it. Thia can <inQluda 
atatamant^ rafaronoing apaoifio worda or linaa. 
" (Diaragard^ inaoouraoiaa.) s 

■ Infaranoing\ Raapondant goaa beyond the text and 
providea motivatlona for oharaotara or davaloBa 
action. It inoludea taxx-baaad hypotheaea ff 
what did happen or pradiotiona about what will 
happan, for example: "The author is longing for 
the home' he onoa had,"' or "A. E. Housman aeema 
to be talking about a country that has been badly 
.damaged or destroyed." 

♦ • 

GN 8 Genefallzatlon t ^ Respon^lent * derivoa general 
meanlnga from the poem, *5M0h aa; "Inalxle a man's 
heart live hla fondest memories.** 

AN a AnaXyals^-'SuperflQlaX i Respondent mentions 
* superficial onaraoterlatlos of the text. This 
inoiudes oonoerns about format, * for example; 
. '^The poem <ioesn*t* rhyme;" "The poem, seems more 
like a story," "It doesn't give the plaoe and 
^ time," "The author uses imaginative language," or 
"There is a sense of Inst beauty in the poem." , 

t \ ■ ' . 

Y = Analysis^ielaborated , Respondent gives an- 

elaboraied or substantive discus,sion of any gne 

of the following special features or literary 

devicesr plot f characters , setting , images , 

sounds, and so' on/ Included here are discussions 

of prot veracity and V m^eaningfulne.ss such as: 

; "Even though Houseman wrote this poem in 1890, it' 

is still pertinent and meaningfu;! today," or 

"Each of us hasinemories of places and people we 

would like to relive, but which time will not 
tt 



allow us tc 



OW ss Othi^r works^-^genef al , Respondent classifies the 
vfork as to genre or type and compares the poem to 
other types of works or art forms in general , 
suoh as: ^It^s not like a poem I've seen 
before," or "It is like a myth." ^ 

^ Z a Other works^.-^speoif ic , Respondent compares the 

poem to a speolfic work which is mentioned by 

• title, such as: "The Bible describes. heaven this 
way." , » 

~ - E v^-^-- Ev^a4W t i^rt ^ - po^ n d ent judges the worth ^af*-L the- 

iwork. TFis also includes such statements as: 

• "It is stupid," ^'I didn't like it," "It doesn't 
make- sense," "It is nicely written," or "It is 
imaginative." \ 

NOTE: In addition to the papers which were considered 
rateable (1 s rateable) and which wei^e analyzed using 
the^^ oategories described above, som^ papers were not 
' considered rateable and these were placed in one of 
the following classifications: 

0 s No response 4 ' 

2 a Nonrateable . Gdpiess or* circular. 

7 a Illegible. Illiterate . 

8 s Totally iff task . 

9 a "I don' t know." 
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Age 17 

Score Point EG (Egobentric) 




oAderStohcfrng poems Qod fx;rWna *^Hq^ 




303 

394 



Age 17 
Scjore Point EG (Cont.) 



309 

395 



Age 17 

Score Poijnt PR (Personal— AhaXytic) 










Age 17 
Scx^xe Point PR (ContJ 





TL 



i^e 17 

Scora Point EM (Baationft.!) 

i 





Age 17 
Score Point EM (Cont. } 
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, ' A^e 17 • 

Soexce Point KC (Synopsis) 




:ri)\<ALU CajTrt^ ^.ro 



« 



fcj, irna^ s^'fCA ;ri;KA:>. ;u»jr*^ ti^ag. ^ 
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Age 17 
Score Point FT (Cont.) 
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. Ags 17 
Score Point FT (Cont,) 



1 



4>£ 
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Age 17 

Soox^ Point IN (Inferencing) 



Age 17 ' 
Spore Point IN (ContJ 















^^^^^^^^^^^^^^^^^^^ AS 



















.T'-f^V^'i^^^-'^ ^'-.'-'s"- ''f,"^ '^^"'h 



404 



408 



Age 17 
Score Point IN, (Cont.) 







Age 17 ... 
Score Point GN (Coht. ) 



^^^^^ ^ rf.^M^/ ir^L^j^ 

r^rl rui is^ U/^^ /gCf &re iM£ 
P/vZ //^^ j6t° £^</ W/:^^ci» V> 



• • • • • • 
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Age 17 

SoQce Point MI (Analysis— Superficial) 





Icaa/)u} j biid. vu^tjj^ 4LLa <yla.QL W6 b^^Jj^j • 

-fi^ ^/:. f/i..i) Wto ULu^ 



IttAAilL » Tkc vuiAAfldhi/1 oXdo /<^JL 4^1^ 





4W. sfoA^-^g. ' 



Age 17 
Score F0I1& AN (Cont.). 





SOL 




^ \ 4g.^ f m^^ ^1^^ c&a/i. cAe^ 




Age 17 

Spore' Point ,0W (Other Worka-~General) 






iziiiii 




.^JLaJj^ ^jbH^ ^^^^^^^^^ -^^^-g--^---^ 



•«««*#* 




415 
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Ag« 17 
Soon Point ON (Cont. } 



4/€ fig/it 

■ ^ r . ■ ■ , / • ' ■ , 

/Oil iJ- r^jojJ £ iKJ .'Xk, Jui^ 
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Aga 17 

Scx}ra Point EV (Evaluation) 



Utff^yA^ hii/f'^Q ^.rt 
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Ag« 17 
Sawt Pcint BV {Cont, ) 

j^ii , I liSmm I II I ^i^ftiiiiiCi^ <ir 

rfiiffl?^. Mil/: Ciiiif 'li!i'^ dfl!!liji(flW.ftiiiiyy i,,,. Uit^Hxt^ ^^ 



T. Ill i»«irii<i 




7 



4 ■ 




4 0 flrtai 



pXidym J ^A^mJl^ '^^m JtJif^ <y^^ j(^ 

ivti*ii T^it/ /"-it^^r r^'"^ A^^^ At^J A# ^.w,v# 



4zi 
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Ag« 17 

Scot* Point X (Ptraonol— Global) 



■ * 
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Ag« 17 
Soon Point ^ (Cont,) 



I % ) ^} / lf ' > jft ii ft i B i lly ' i Vlfl i klQ i, j l j i fcg II P, Ao ^< > i Ot^ 



416 420- 



Agt 17 
Soon Point X (Gortt,) 

f 

It ■ 
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„r,.,/,, 




■ % X< l l l t^ l! «llllW > llli /fl l ^fl| lll WI»M lt ^ 




####### 




I 
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4-2p2O03r*22B-J. 

Hm i»%90$m about which you tre going to be tsked two 
qutitioiiai, I wilt rtad tht po*m to you tt you rftd it to 
l^^mt^^^ will 
ftt^ y«ii III* llftt ^tttitioa ind you are to.fitl in tht pvtl 
hiiMit tha aaiwn you think bait. Than rwlU raad the 
Mooad quatUon to you and you ara to write your ansYer in 
the anawar space. 



Aa the aat 

aaiai^y 
than^tha hind 
itapfa|d^n 

into the pit of 
the empty 
flowerpot 



WUliani Carlos WUliams 



PLEASE CONTINUE ON THE NEXT PAGE 
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4-202002-2ffl-l 
(Contiiiued) 

A. Which of th« following do you think the poet li really doing? 

o He ii worried about the ctt. 

C3 He it being mad at the oat. 

c=3 He is being Md about the cat. 

mm He is describing the cat's movements. 

C3 ' I don't know. 

B. What are your reasons for choosing your answer to 
question A? 




DO NOT CONTINUE 
UNTIL TOLD TO DO SO. 
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VAZF HO.; 

1979*60 Obitctiv«i 
1979?;80 Sttlibbltctivtt: 

1970-71 ObKictive; 
1970-71 th«a«: 

Sft€ional B«sults: 



1979-80 

Package Execclse: 
1970-71 

Package Exerelfie: 

Total. Tiae In Seconds: 



tt-202002^22(B-1 ♦ 

/ 

Pact k - Bttltiple Choice 
Pact B - Open inded 

^:tll^l>on'(Ss:''t6:V«ii:i^ vociw ^:in^;v;' . 
:i;iiticpEet4f •;:iftMivalttatlte:: ¥ 

Pact A - %Wap^«%'vcltten wocka 
Pact B - llt^jtt^Jecatanding o£ 
ncitten ¥oc^im1io«^^, -'-^ , 

intecpceta1^<»fe;'r^::t*>1^. ... 

---~'-^«d'' in, Pinds -Heanings 



>Becoa<aiiSv 

ln,i:ia||d>:SvaattaieiB a «cck of 

Pac^■'^^l^7?■WcU'*K^''] 
pact B ^ Band scoced 









on* 


A 




00 


B 




01 




39^10 : 


03 


B 




05* 


B 


11. M8 


07 


B 




08 


B 


.15^ 


09 


B 


7.83 


01 


BC 


«7.5tt 


01 


BF 


.32 


01 


BSB 


2.07 


00 


BN 


a. 08 


01 


BB 


36.32 


02 


BH 


10.11 


03/ 


BN 


1.32 


04 


Br 


.05 


08 


BH 


48.14 






0811 






0217 






0234 



m 
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source Inforaation: - ••Poea" . fcoi Nilliai Carlos 

Copyright 1938 by Hen Diyoctlons 
Pttbliihing Corporation* R«prlQted 
by poriisiion of How Directions* 

* Tho rang* of rosponso porcontaf* valoas listed for the 
open-ended portion of this exercise represent . both 
acceptable responses, which are lacked with an asterisk 
(*) « and unacceptable responses (all ethers). in 
addition, ' the score points sarked with the second 
alphabetic codes (C,P,SB or M) refer back to the second 
and third categorizations on the . scoring gui^e* 
C«content, ?«4ors, SS«subject.lTe reaction r and M»nunber 
of pieces of evidence. ?or convenienccif score points 1 
and 2 hav€ been cosbined into 1, and sctire pcints 4 and 5 .. 
have been cosbined into ;5t* ?6r exercises without a 
aicore point 1 on the scoring gttide, the, percentage value 
for score point 1 on the docusentation page consists of 
responses fros score point 2 only^ 



SCORIHG GUIDE— RESPONDING TO LITERATURE 
- EXPLAINING RESPONSES TO LITERATURE 



. Inferencing 
•»A8 the Cat" 
4-202002-238-1 
Age 9, ffiokage 8, Exercise 11 

General Scoring Rationale : Since the. responding . to 
literature ohjeotlye was formulated to address 
**del liberate, oonafolou«|.r kinds of interpretation," a 
successful' , respbna<Si^:^o.t , oply should identify the 
nature, meatting>or^'p'urp%>8e. of the poem but also should 
explain the^glf0.Mnt%riin*tMtion by relating It to the 
text. Evi'de1»l^^^cairfbe' given by citing specific events 
in the -tex.l or, special aspebts of the 'construction of 
the text%'-" VWiti^fefJ . .---.-'•'^ 

Scoring Guide" Cateeianiifes : 

I. Flratt^r Cii tejib r iia t io n — Sub stantiation of choice of 



Flrgt. CareibrlZi 

foil in muitip;Le chQlee part of exercise. 

.2 s Choioil^lsiunsu^^ . Responses tend to 

provider; , circular^, evidence, \such. as: "It 
, UBil'iiQrM:*:^^^^^^ t)ie iext with or- 

wl'tWCit : jmihor (VCfTiiocUn^'cies 3) Vague, reasons^ 
sucKretr!.";ta^^»,/way^Ult|raounds," , ."TKer\way the 




talking about' the cat's"' movements," "It sounds 
like the cat's,moVemehts," "It sounds^ like what 
happened in the poem, ♦♦^nd so on; or U) only a 
subjective r'eactioh as substantiation. 

3 = Choice " subdl^^^ . ^^^fi minimal evidence .'^ 

Respohdents substantiate their cholceCs) with 
only one reasonOor piece of evidence related to 
the text. 

A. Reason can be directly related to the text, 
for example: "Because he told th^ cat*s 
every movement"; "Because he show the 
movement"; "Telling how. the cat movements 
was";, "He Is telling what the cat's 
movements are"; "Because he did something"; 
• "That's because the' cat is doing"; or 
-"-Because he has the words Jamcloset, 
forefoot, bind." . 

426 430 



B. Reason can be inferred from the text^ for 
Example: ^Because the cat jumped around,^ 

C. Reason can be inaccurate i if it is ^related 
to the text I for example : ^Worried , 
because the cat might fall** or **Because the 
cat was lost.** 

D. Reason can be based on personal experience 
that is related to the text, such as: **He 
worried because your mom worries about you 
when you are not there.** 

E. Reason *can refer to (but not retell) 
specific places in the text, such as: 
**Bec.ause of what it says in the last 
paragraph.** 

4 s Choice substantiated . Respondents substantiate 

thelt choiceCs) ,^ith at least two reasons or 
pieces of/ evl)denc9, related Fo " the text. 

I an 
•ibed 

"Forefoot and.,, then , the ; hind .steps-^ down or 
"He Is ,:'deacr*iblng,' the Teat ' s mbVements . What 

5 a Chald(^IWleinli'a?ed'^^^ ' -cbmWnt- fashion . 



ar^'fbr^sehi^'eq^^^ogldally a and are 

clear Iy: jt!^lfet6dXto the' , tiext; such as:' **It 
tell»;#illj'5^^^^ got down from the jam 

c 1 o set I land' land ed Fin ^ the f 1 o we r p6 1 . " 

NOTE: The following types of papers were 
classified as indicated and received no further 
scoring: 

0 s -response . 
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7 s IlleRlble or Illiterate . . 

8 s Totally off taak . 

9 s * *l don't know ." r 

NOTE: There la no acore point 1 for thia exerciae. 

Second Gategorlztftlon- -Theaouroe: of the evidence. 
Code preaenoe or ' abaeno^ for' each o f the followi ng : 

la Content. The evidence ia baaed on the content 
in the text. 

2 s Form . The evidence la baaed on the language, 

atyle or conatructipn of the text, ^ 

3 s Subjective reactiona . Some reaponaea judge the 

worth of all or< part of the text, for example: 
«I 'd|)^i'iki.r^^^^^ or "It waa intereating." 

PeraonalTop^ the ac.tiona - of the 

charact'^irs', are:, stated or- referencea to the 
moraly,;^'j;!t>fiei.!atory or general phlloaophical 
atiatera'ehts : ."Keep trying." . 

NOTE: Content and form can be preaent only if 
primary categorization - ia a "3" through "5"j 
aubjectlve'^ rMotlbria can be preaent in papera 
categorized '?.2??'^. through "5." 

Third Ciategorizatlon* -A count of the number of 
reaaona or plecea of ^evidence. Categorization for 
the count of , details ia aa followa: (1), (2), (3), 
(4), (5), (6), (7 or more); NOTEt Thia count only 
appliea to papera with primary categorization of 
"S** through ^♦5''; ;aubjective reactions should n^ 
counted aa reasons or evidence. 



L;;lK^i!,:>;i;.:i''t;-.i;, 



Score Point 2 



Ha ii dtfcribing th« e^^^ 



• H« is descrfl>ing the eatVmbvements. ^^^^ ^ 




He it describing tl^e cat's movements. 




i 



Y sr. 
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I'll vi>\ 1 -I 




Ho is describing the eat*s movenents. 



7 P 
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Soc»re Point 4 



^ Ht it dtie^iAg tht ett'tfflovMBtsts. ■ 



H« ii|leiexibing tho ett*a movmneats. 



Age sl 
Subjective Beactlons 



mm He is describing the eit*s movements. 



••••••• 



^ . ^ip* He is describing the cat's movements. 





«9 He is describing the^ e^^ 
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4-202024-22B-2,3 

Here is a poem about which you are going to be asked two questions. I 
will read the poem aloud as you read it to younelf. When we have read 
the poem carefully, I will read you the first question and you are to 
fm in the oval beside the answer you think best Then 1 will read.the 
second question to you and you are to write your answer in the answer 
space. 

The Dosing of the Rodeo 

Thef lariat snaps; the cowboy rolls 
His pack, and mounts and rides away, 
to the land the cowboy goes. 

P^imies of smoke from the factory sway 
In the setting sun. The curtain falls, 
A train in the darkness pulls away. 

tioodbye, says the rain on the iron roofs. 

Goodbye, say the barber poles. 

Dark drum the vanishing horses* hooves. 

I William Jay Smith 

Which of the following do you think describes the mood of this 
poje'm? 

C^D Angry 
CZ> Cheerful 
\cD Humorous 

Sad 

/ 



I don't know. 



PLEASE CONTINUE ON THE NEXT PAGE 
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4-202024-22B-2,3 
(Continued) 

B. What are your reasons for choosing your answer to question A? 




Cr^B I DONNOT CONTINUE 
^■Wr I UNTIIxTOLD TO DO 
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NAEP No. : 
Exercise Type: 

1979-80 Objective: 

1979-80 Subobjective: 



1970-71 Objective; 



1 970-71- Thene: 
HAEF Scoring: 

Aqes 

National Results: 



1979-80 

Fackaqe Exercise: 
1970-71 

Package Exercise: 



U-20202a-22B-23 ♦ 

Part I - Hiiltiple Choice 
Part - B - open Ended 

Responds to vritten works in 
interpretive and evalnative vays 

Part A - Evaluates written works 
Part E - Extends understanding of 
written works through 
interpretation 

Becoees Engaged in, Finds Heanings 
in, and Evaluates a icrk of 
Literature , 



Responding to Literature 



Part 
Part 



A - Hachine Scored 
B - Hand Scored 

12 



17 



04* 


k 


82.40 


88.35 


00 


B 


2.51 


2.73 


01 


B 


28.46 


16.56 


\03 


B 


32.05 


37.90 


05* 


B 


32.18 


41.24 


07 


B 


.29 


.19 


08 


B 


.17 


.11 


09^ 


B 


4.34 


1.29 


01 ■ 


BC 


63.70 


77.34 


Oli 


BF 


.84 


4.04 


Oil 


BSB 


4.79 


9.11 


OOi 


BN 


2.51 


2.73 


01 


BM 1 


32.08 


37.90 


02 


BN ' 


20.76 


23.55 


03 


BN 


8.07 


11.55 


04 


BN 


2.34 


4.39 


05 


BN 


.92 


1.32 


06 


BN 


.09 


.28 


07 


BN 




.15 


08 


BN 


33.23 


18;14 






0711 


0709 






0617 


0419 



Total Tiaie in Seconds: 



0236 



,0357 



Source Information; 



t'The Closing of the Bodeo". 
Reprinted from NEW AND SELECTED 
POEHS by Nllllaa Jay Smith. 
Copyright © 1 9i»7 ^ 1 970 by 
Hllllan Jay Smith and ased^ by 
permission of the publisher, 
pelacorte Press/Seymour Lavrence. 



* The range of response percentage values listed for the 
open<-ended portion of this exercise represent both 
acceptable responses, vhlch are marked with an asterisk 
{*) , and unaccepteible responses (all ethers). In 
addition, the score points marked vlth the second 
alphabetic codes (C/F^SB pr N) refer back to the second 
and third categorizations oh ^ the scoring guide. 
C^content, F»form, SRssubjectlve reaction, and Nenumber 
of pieces of evidence. For convenience, score points 1 
and 2 have been combined into 1, and score points 4 and 5 
have been combined into 5^. For exercises vlthoat a 
score point 1 on the scoring guide, the percentage value 
for score point 1 on the documentation page consists of 
responses from score point 2 only. 
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SCORING GUIDES-RESPONDING TO LITERATURE 
EXPLAINING RESPONSES TO LITERATURE* 



Inferencing — Mood 
"Rodeo" 
4-202024-22B-2,3 ^ ^ 
Age 13f Package 7, Exercise 11 
Age 17, Package 7, Exercise 9. 

General Scoring Rationale ; Since the responding to 
literature o,bjective was formulated to address 
"deliberate, conscious kinds of Interpretation," a 
successful response not only should Identify the mood 
but also should explain the given Interpretation by 
relating it to the text. Evidence can be given by 
biting specific events in the text or special aspects 
of the construction of the text. 

Scoring Guide Categories ; 

I. Firsts Categori2atl6n- »'"Substantlatlon of mood. 

V 2 = Mdod is unsubstantiated . Respondents do not 
substantiate their cholce(s) with evidence from 
the text. Responses tend to provide: 1) 
^circular evidence such as; "It was sad because 
it was sad"; ;2y a copy or close paraphrase of/ 
the text; 3) vague reasons like "The way it, 
sounds," "The way the author wrote it," "The 
words used," "The way it is made,** and so on; 
or 4) . only a subjective, ^ reaction as 
substantiation. 

3 = Mood substantiated with minimal evidence . 
Respondents substantiate their choice(s) of 
mood with ohlv one reason or piece of evidence 
related to the text. 

A. Reason can be directly related to the text, 
such as: "It was sad, because he was all 
alone." 

B. Reason can be inferred from the text, such 
as: "Sad, because the cowboy lost the 
rodeo." 




C. Reason can be InaoouratOi if It la related 
to the taxti auoh as: '*HumorouS| because 
the cowboy rolls*^ or *'Sad| because of 
pollution t'» 

D. Reason can be based on personal experience 
that is related to the text. 

E. Reason can refer to (but not retell) 
specific places in the text, such as: 
^Because of what it says in the last 
paragraph." NOTE: "The way he read it" is 
not a reason, since it is not related to 
the text. 

i| s Mood substantiat ed. . Respondents substantiate 
their oholceCa) of mood* with at least two 
reaaons or pieces of evidence related to the 
text. However, the evidence may be presented, 
in an amtJiguous fashion or be of the types, 
described in 3C-*3^« Reasons must be distinct — 
V' not instances of the same reason. It may take, 
for example, two* bits of Information to make a 

^ single point such as: "(Sad) because he liked 
to be in the rodeo, but it, was over." 

5 = Mood aubstantiated in a coherent fashion . 
Aespondentji^ substantiate their cholceCs) of 
mood wl th at least two reasons or pieces of 
evidence clearly related to the; text-^"^di^ 
related , or can be readilry Inferred . The 
reasons are presented logically and coherently^ 

NOTE: The fo^llowlng types of papers were 
classified as Indicated and received no further 
scoring:? < 

0 s No response . 

7s Illegible or illiterate . 

8 = Totally off task . 

9 - " I don* t know v!* ^ 

NOTE: /Theire is no s^ point 1 for.' this exercise . 

Set: bnd Cat eg or 1 za t lo n- * '^Th e so unc e of the evidence. 
Code preaence or aD sence for each of the following: 

1 s Content ; The evidence is b ased ,on the content 

ift the text , for example: "Everything got 

■V:dark..";. [ : ... 



2 » Form . The fvldeno©, la based \on the language, 

if^e or oonstruotion of the text, for example; 
"It haa alow, low talk,"- M 

3 s SubJeotlve reaotiona^ , Theae are reaponaea that 

judge, the worth or all or part\Df the text,, for 
example: "I dlallke poetry," "It waa 
intereating," or "It waa monoto|noua." Peraonal 
opiniona about the aotlona of the dharaotera 
are atated or referenoea to the \ moral of the 
atory Qi*^ general philoaophioal atatementa, auch 
aa: "Keep trying." ^ v . 

NOTE: Content or form can be preaent only if the 
primary categorization ia a "3" \ through "5"; 
subjeotive 'reactiona can be .preaent in papera 
categorized "2" through "5." \ 

HI. . Third Categorization— A count of the number, of 
'reaaons or piecea of evidence. Categorization for 
the count of detaila is aa followa: (1 ) , (2), (3)i 
, ('i*) , (5) , (6) , (7 or jiore) . NOTE: Thia count only 
appliea to papera wifn primary categorization "of 
"3" through "5"; aubjeotive reactiona ahould not be 
counted aareaaona or evidence. , y 
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Age 17 
Score Point 4 
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